Sep 25 15:57:55 devstack cinder-volume[76101]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 15:57:55 devstack cinder-volume[76101]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 15:57:55 devstack cinder-volume[76101]: we strongly recommend against using it for new projects. Sep 25 15:57:55 devstack cinder-volume[76101]: If you are already using Eventlet, we recommend migrating to a different Sep 25 15:57:55 devstack cinder-volume[76101]: framework. For more detail see Sep 25 15:57:55 devstack cinder-volume[76101]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 15:57:55 devstack cinder-volume[76101]: import eventlet # noqa Sep 25 15:57:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 15:57:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 15:57:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 15:57:59 devstack cinder-volume[76101]: INFO dbcounter [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Registered counter for database cinder Sep 25 15:57:59 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:00 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writer thread running {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:58:00 devstack cinder-volume[76101]: INFO cinder.rpc [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 15:58:00 devstack cinder-volume[76101]: INFO cinder.rpc [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 15:58:00 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:00 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Determined volume DB was empty at startup. Sep 25 15:58:00 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76101) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 15:58:00 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 15:58:00 devstack cinder-volume[76101]: WARNING stevedore.named [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:58:00 devstack cinder-volume[76101]: WARNING castellan.key_manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:00 devstack cinder-volume[76101]: WARNING cinder.keymgr.conf_key_mgr [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:00 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76101) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 15:58:00 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.468s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:01 devstack cinder-volume[76101]: INFO cinder.rpc [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 15:58:01 devstack cinder-volume[76101]: INFO cinder.rpc [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 15:58:01 devstack cinder-volume[76101]: WARNING stevedore.named [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:58:01 devstack cinder-volume[76101]: WARNING castellan.key_manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:01 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:01 devstack cinder-volume[76101]: INFO oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Starting 1 workers Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Started child 76256 {{(pid=76101) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Full set of CONF: {{(pid=76101) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] ******************************************************************************** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Configuration options gathered from: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] ================================================================================ {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 15:58:01 devstack cinder-volume[76256]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] allow_availability_zone_fallback = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] allow_compression_on_image_upload = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] allowed_direct_url_schemes = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] api_rate_limit = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] auth_strategy = keystone {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] az_cache_duration = 3600 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_availability_zone = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_host = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_stats_polling_interval = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backup_api_class = cinder.backup.api.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backup_name_template = backup-%s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backup_use_same_host = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backup_use_temp_snapshot = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] chap_password = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] chap_username = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_internal_tenant_project_id = 00c2db976f0c49319a71adeafba01c94 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_internal_tenant_user_id = 668bb62493884c5789fae31946349df9 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cloned_volume_same_az = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cluster = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] compression_format = gzip {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] compute_api_class = cinder.compute.nova.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] config_dir = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] config_source = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] control_exchange = openstack {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] debug = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] default_availability_zone = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] default_group_type = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] default_volume_type = lvmdriver-1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] disk_geometry = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_client_cert = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_client_cert_key = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_data_namespace = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_ssl_cert_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_ssl_cert_verify = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] driver_use_ssl = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] enable_force_upload = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] enable_new_services = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] enable_unsupported_driver = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] enforce_multipath_for_image_xfer = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] filter_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_api_insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_api_ssl_compression = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_ca_certificates_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_catalog_info = image:glance:publicURL {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_num_retries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance_request_timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] goodness_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] graceful_shutdown_timeout = 5 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] group_api_class = cinder.group.api.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] host = devstack {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_compress_on_upload = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_conversion_address_space_limit = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_conversion_cpu_limit = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_conversion_disable = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: INFO cinder.volume.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_introspection_address_space_limit = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_introspection_cpu_limit = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_upload_use_cinder_backend = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_upload_use_internal_tenant = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_volume_cache_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_volume_cache_max_count = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] init_host_max_objects_retrieval = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] instance_format = [instance: %(uuid)s] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iscsi_target_flags = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iscsi_write_cache = on {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iser_helper = tgtadm {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iser_ip_address = 192.168.122.65 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iser_port = 3260 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_color = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_config_append = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_dir = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_options = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_rotate_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_rotate_interval_type = days {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] log_rotation_type = none {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] max_age = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] max_logfile_count = 30 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] max_logfile_size_mb = 200 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] max_over_subscription_ratio = 20.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] message_reap_interval = 86400 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] message_ttl = 2592000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] monkey_patch = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] monkey_patch_modules = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] my_ip = 192.168.122.65 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] no_snapshot_gb_quota = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] num_iser_scan_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] num_shell_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] num_volume_device_scan_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] nvmeof_conn_info_version = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] nvmet_ns_id = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] nvmet_port_id = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_max_limit = 1000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_ext_list = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_listen_port = 8776 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_use_ssl = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] osapi_volume_workers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] per_volume_size_limit = -1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] periodic_fuzzy_delay = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] periodic_interval = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] public_endpoint = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] publish_errors = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_backup_gigabytes = 1000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_backups = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_gigabytes = 1000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_groups = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_snapshots = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] quota_volumes = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] rate_limit_burst = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] rate_limit_except_level = CRITICAL {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] rate_limit_interval = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] reinit_driver_count = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] replication_device = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] report_discard_supported = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] report_interval = 120 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] reservation_clean_interval = 86400 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] reservation_expire = 86400 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] reserved_image_namespaces = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] reserved_percentage = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] rpc_response_timeout = 120 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] run_external_periodic_tasks = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] scst_target_driver = iscsi {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] scst_target_iqn_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_down_time = 720 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] shell_completion = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] snapshot_name_template = snapshot-%s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] snapshot_same_host = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] split_loggers = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] state_path = /opt/stack/data/cinder {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] storage_availability_zone = nova {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] storage_protocol = iSCSI {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] syslog_log_facility = LOG_USER {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_helper = lioadm {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_ip_address = 192.168.122.65 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_port = 3260 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_protocol = iscsi {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] target_secondary_ip_addresses = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] trace_flags = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] transport_url = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] until_refresh = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_chap_auth = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_default_quota_class = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_journal = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_json = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_multipath_for_image_xfer = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_stderr = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] use_syslog = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] verify_glance_signatures = enabled {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_api_class = cinder.volume.api.API {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_backend_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_clear = zero {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_clear_ionice = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_clear_size = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_copy_bps_limit = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_dd_blocksize = 1M {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_name_template = volume-%s {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_service_inithost_offload = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volume_usage_audit_period = month {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] zoning_mode = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.auth_section = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.auth_type = password {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.auth_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.cache = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.interface = public {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_password = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack sudo[76260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 15:58:01 devstack sudo[76260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcache_username = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.region_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.service_type = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.backend = dogpile.cache.null {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.backend_argument = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.backend_expiration_time = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.config_prefix = cache.oslo {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.debug_cache_backend = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.enable_retry_client = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.enable_socket_keepalive = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.expiration_time = 600 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_dead_retry = 300 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_pool_maxsize = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_sasl_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.password = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.proxies = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.redis_db = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.redis_server = localhost:6379 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.retry_attempts = 2 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.retry_delay = 0.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.socket_keepalive_count = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.socket_keepalive_idle = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.socket_keepalive_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.socket_timeout = 1.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.tls_allowed_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.tls_cafile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.tls_certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.tls_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.tls_keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cache.username = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] coordination.backend_url = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.asyncio_connection = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.asyncio_slave_connection = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.backend = sqlalchemy {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.connection = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.connection_debug = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.connection_parameters = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.connection_recycle_time = 3600 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.connection_trace = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.db_inc_retry_interval = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.db_max_retries = 20 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.db_max_retry_interval = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.db_retry_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.max_overflow = 50 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.max_pool_size = 5 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.max_retries = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.pool_timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.retry_interval = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.slave_connection = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.sqlite_synchronous = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.synchronous_reader = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] database.use_db_reconnect = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_tracing.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.connection_string = messaging:// {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.es_doc_type = notification {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.es_scroll_size = 10000 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.es_scroll_time = 2m {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.filter_error_trace = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.hmac_keys = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.sentinel_service_name = mymaster {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.socket_timeout = 0.1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.trace_requests = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler.trace_sqlalchemy = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler_jaeger.process_tags = {} {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] profiler_otlp.service_name_prefix = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.policy_default_rule = default {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.policy_file = policy.yaml {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.group = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.helper_command = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] privsep_osbrick.user = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.group = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.helper_command = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] cinder_sys_admin.user = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.auth_section = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.auth_type = password {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.cafile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.collect_timing = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.send_service_user_token = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.split_loggers = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.tls_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] service_user.tls_min_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.auth_section = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.auth_type = password {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.collect_timing = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.region_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.split_loggers = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.tls_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] glance.tls_min_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.backend_availability_zone = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.chap_password = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.chap_username = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.disk_geometry = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_client_cert = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_data_namespace = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.driver_use_ssl = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.extra_capabilities = {} {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.filter_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.goodness_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iscsi_target_flags = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iser_helper = tgtadm {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iser_port = 3260 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.lvm_share_target = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.lvm_type = auto {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.replication_device = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.report_discard_supported = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_helper = tgtadm {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_port = 3260 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_protocol = iscsi {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.trace_flags = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.use_chap_auth = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_backend_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_clear = zero {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_reports.file_event_handler = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_reports.log_dir = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.backend_host = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.chap_password = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.chap_username = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.disk_geometry = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.filter_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.goodness_function = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iser_helper = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iser_ip_address = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iser_port = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.lvm_share_target = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.lvm_type = auto {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.num_shell_tries = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.replication_device = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.storage_protocol = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_helper = lioadm {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_ip_address = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_port = 3260 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.trace_flags = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.use_chap_auth = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_clear = zero {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_clear_size = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] lvmdriver-1.volumes_dir = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_notifications.driver = [] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] key_manager.fixed_key = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.barbican_api_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.barbican_endpoint = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.barbican_endpoint_type = public {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.barbican_region_name = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.cafile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.collect_timing = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.number_of_retries = 60 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.retry_delay = 1 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.send_service_user_token = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.split_loggers = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.tls_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.tls_min_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.verify_ssl = True {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican.verify_ssl_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.auth_section = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.auth_type = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.cafile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.certfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.collect_timing = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.insecure = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.keyfile = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.split_loggers = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.timeout = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.tls_ciphers = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] barbican_service_user.tls_min_version = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.approle_role_id = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.approle_secret_id = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.auth_method = approle {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.auth_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.kv_mountpoint = secret {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.kv_path = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.kv_version = 2 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.namespace = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.root_token_id = **** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.ssl_ca_crt_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.timeout = 60.0 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.token_file = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.token_role = None {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.use_ssl = False {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:01 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] ******************************************************************************** {{(pid=76101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 15:58:01 devstack sudo[76260]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:01 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:01 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:01 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:02 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.284s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 15:58:02 devstack cinder-volume[76256]: INFO cinder.brick.local_dev.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:02 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:02 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:02 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG cinder.brick.local_dev.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76256) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:02 devstack sudo[76600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:02 devstack sudo[76600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:02 devstack sudo[76600]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.545s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:02 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:02 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:02 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:03 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:03 devstack sudo[76865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 15:58:03 devstack sudo[76865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:03 devstack sudo[76865]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.337s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:03 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:03 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:03 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:03 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:03 devstack sudo[76951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:03 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:04 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:04 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:04 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:04 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:04 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:04 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:04 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:04 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:04 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:04 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:05 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:05 devstack cinder-volume[76256]: INFO cinder.volume.drivers.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:05 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:05 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:05 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:05 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:05 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:05 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:05 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:05 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:05 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:05 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:05 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:05 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:06 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:06 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:06 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:06 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:06 devstack cinder-volume[76256]: INFO cinder.volume.driver [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG cinder.volume.driver [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76256) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG oslo_db.sqlalchemy.engines [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writer thread running {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG cinder.db.api [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Building query based on filter {{(pid=76256) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG cinder.image.image_utils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76256) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 15:58:06 devstack cinder-volume[76256]: INFO cinder.keymgr.migration [None req-b34aa4bd-5c19-44ee-baa6-3849699e911d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:06 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:06 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:06 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:07 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:07 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:07 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:07 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:07 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:07 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:07 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:07 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:07 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:07 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:08 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG cinder.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Notifying Schedulers of capabilities ... {{(pid=76256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 15:58:08 devstack cinder-volume[76256]: INFO cinder.volume.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Driver initialization completed successfully. Sep 25 15:58:08 devstack cinder-volume[76256]: INFO cinder.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Initiating service 2 cleanup Sep 25 15:58:08 devstack cinder-volume[76256]: INFO cinder.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Service 2 cleanup completed. Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG cinder.service [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Creating RPC server for service cinder-volume {{(pid=76256) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG cinder.service [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76256) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 15:58:08 devstack cinder-volume[76256]: INFO cinder.volume.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:08 devstack sudo[77125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:08 devstack sudo[77125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:08 devstack sudo[77125]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:08 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:08 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:08 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:08 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:08 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:08 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:09 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:09 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:09 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:09 devstack sudo[77139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:09 devstack sudo[77139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:09 devstack sudo[77139]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:09 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:09 devstack cinder-volume[76256]: INFO cinder.volume.manager [None req-dd258fe6-1b51-4bf1-8418-312836a6c8b8 None None] Driver post RPC initialization completed successfully. Sep 25 15:58:11 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:18 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:58:18 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread count: 6 {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 15:58:18 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread info: [<_MainThread(MainThread, started 132237725311104)>, , , , , ] {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 15:58:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:SELECT=4 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:59:18 devstack sudo[79194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:59:18 devstack sudo[79194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:59:18 devstack sudo[79194]: pam_unix(sudo:session): session closed for user root Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:59:18 devstack sudo[79198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:59:18 devstack sudo[79198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:59:18 devstack sudo[79198]: pam_unix(sudo:session): session closed for user root Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:59:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:59:18 devstack sudo[79201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:59:18 devstack sudo[79201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:59:19 devstack sudo[79201]: pam_unix(sudo:session): session closed for user root Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:59:19 devstack sudo[79204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:59:19 devstack sudo[79204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:59:19 devstack sudo[79204]: pam_unix(sudo:session): session closed for user root Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG cinder.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Notifying Schedulers of capabilities ... {{(pid=76256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread count: 6 {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 15:59:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread info: [<_MainThread(MainThread, started 132237725311104)>, , , , , ] {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:18 devstack sudo[82507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:00:18 devstack sudo[82507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:18 devstack sudo[82507]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:18 devstack sudo[82513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:18 devstack sudo[82513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:18 devstack sudo[82513]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:19 devstack sudo[82520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:00:19 devstack sudo[82520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:19 devstack sudo[82520]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:19 devstack sudo[82523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:19 devstack sudo[82523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:SELECT=1 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:UPDATE=1 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:00:19 devstack sudo[82523]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG cinder.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Notifying Schedulers of capabilities ... {{(pid=76256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread count: 6 {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:00:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread info: [<_MainThread(MainThread, started 132237725311104)>, , , , , ] {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:01:18 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:01:18 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:01:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:18 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:01:18 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:18 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:18 devstack sudo[84366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:18 devstack sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:19 devstack sudo[84366]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:19 devstack sudo[84395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:01:19 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:19 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:19 devstack sudo[84404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:19 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:19 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG cinder.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Notifying Schedulers of capabilities ... {{(pid=76256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread count: 6 {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:01:19 devstack cinder-volume[76256]: DEBUG cinder.volume.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] thread info: [<_MainThread(MainThread, started 132237725311104)>, , , , , ] {{(pid=76256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:02:18 devstack cinder-volume[76256]: DEBUG oslo_service.periodic_task [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:02:18 devstack cinder-volume[76256]: DEBUG cinder.volume.drivers.lvm [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Updating volume stats {{(pid=76256) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:02:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:18 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:02:18 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:18 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:18 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:18 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:02:18 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:19 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:19 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:02:19 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:19 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:19 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:02:19 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:SELECT=1 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG dbcounter [-] [76256] Writing DB stats cinder:UPDATE=1 {{(pid=76256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:19 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG oslo_concurrency.processutils [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:19 devstack cinder-volume[76256]: DEBUG cinder.manager [None req-048ba072-a26b-4c66-8d0c-55a8883b09f1 None None] Notifying Schedulers of capabilities ... {{(pid=76256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:57 devstack cinder-volume[76101]: INFO oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Caught SIGTERM, stopping children Sep 25 16:02:57 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Acquiring lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:57 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Acquired lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:57 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Releasing lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:57 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Stop services. {{(pid=76101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:02:57 devstack cinder-volume[76101]: DEBUG oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Killing children. {{(pid=76101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:02:57 devstack cinder-volume[76101]: INFO oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Waiting on 1 children to exit Sep 25 16:02:58 devstack cinder-volume[76256]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Acquiring lock "singleton_lock" {{(pid=76256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:58 devstack cinder-volume[76256]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Acquired lock "singleton_lock" {{(pid=76256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:58 devstack cinder-volume[76256]: DEBUG oslo_concurrency.lockutils [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Releasing lock "singleton_lock" {{(pid=76256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:58 devstack cinder-volume[76256]: WARNING amqp [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:58 devstack cinder-volume[76256]: WARNING amqp [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:58 devstack cinder-volume[76101]: INFO oslo_service.backend._eventlet.service [None req-5d88f5e4-a710-4412-a81a-c4c9700429d1 None None] Child 76256 exited with status 0 Sep 25 16:02:58 devstack cinder-volume[86318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:02:58 devstack cinder-volume[86318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:02:58 devstack cinder-volume[86318]: we strongly recommend against using it for new projects. Sep 25 16:02:58 devstack cinder-volume[86318]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:02:58 devstack cinder-volume[86318]: framework. For more detail see Sep 25 16:02:58 devstack cinder-volume[86318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:02:58 devstack cinder-volume[86318]: import eventlet # noqa Sep 25 16:03:00 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:00 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:00 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:01 devstack cinder-volume[86318]: INFO dbcounter [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Registered counter for database cinder Sep 25 16:03:01 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG dbcounter [-] [86318] Writer thread running {{(pid=86318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:02 devstack cinder-volume[86318]: INFO cinder.rpc [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:03:02 devstack cinder-volume[86318]: INFO cinder.rpc [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Determined volume DB was empty at startup. Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG cinder.volume.manager [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:03:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:03:02 devstack cinder-volume[86318]: WARNING stevedore.named [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:03:02 devstack cinder-volume[86318]: WARNING castellan.key_manager [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:02 devstack cinder-volume[86318]: WARNING cinder.keymgr.conf_key_mgr [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:02 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Starting 1 workers Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Started child 86532 {{(pid=86318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Full set of CONF: {{(pid=86318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Configuration options gathered from: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] ================================================================================ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] allow_availability_zone_fallback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] allow_compression_on_image_upload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] allowed_direct_url_schemes = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] api_rate_limit = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] auth_strategy = keystone {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86532]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_stats_polling_interval = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backup_api_class = cinder.backup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backup_name_template = backup-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backup_use_same_host = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backup_use_temp_snapshot = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] chap_username = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_internal_tenant_project_id = 00c2db976f0c49319a71adeafba01c94 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_internal_tenant_user_id = 668bb62493884c5789fae31946349df9 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cluster = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] compression_format = gzip {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] compute_api_class = cinder.compute.nova.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] config_dir = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] config_source = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] control_exchange = openstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] debug = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] default_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] default_group_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] default_volume_type = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_ssl_cert_verify = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] driver_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] enable_new_services = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] enable_unsupported_driver = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] enabled_backends = ['QuobyteHD'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_api_insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_api_ssl_compression = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_ca_certificates_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_catalog_info = image:glance:publicURL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_num_retries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance_request_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] graceful_shutdown_timeout = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] group_api_class = cinder.group.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] host = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_compress_on_upload = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_conversion_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_conversion_cpu_limit = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_conversion_disable = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_introspection_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_introspection_cpu_limit = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_volume_cache_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_volume_cache_max_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] init_host_max_objects_retrieval = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] instance_format = [instance: %(uuid)s] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iscsi_target_flags = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iscsi_write_cache = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iser_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iser_ip_address = 192.168.122.65 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iser_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_color = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_config_append = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_options = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_rotate_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_rotate_interval_type = days {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] log_rotation_type = none {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] max_age = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] max_logfile_count = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] max_logfile_size_mb = 200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] max_over_subscription_ratio = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] message_reap_interval = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] message_ttl = 2592000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] migration_create_volume_timeout_secs = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] monkey_patch = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] monkey_patch_modules = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] my_ip = 192.168.122.65 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] no_snapshot_gb_quota = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] num_iser_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] num_shell_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] num_volume_device_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] nvmeof_conn_info_version = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] nvmet_ns_id = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] nvmet_port_id = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_max_limit = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_ext_list = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.remotefs [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86532) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_listen_port = 8776 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] osapi_volume_workers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] per_volume_size_limit = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] periodic_fuzzy_delay = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] periodic_interval = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] public_endpoint = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] publish_errors = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_backup_gigabytes = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_backups = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_gigabytes = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_groups = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_snapshots = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] quota_volumes = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] rate_limit_burst = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] rate_limit_except_level = CRITICAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] rate_limit_interval = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] reinit_driver_count = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] report_discard_supported = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] report_interval = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] reservation_clean_interval = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] reservation_expire = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] reserved_image_namespaces = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] reserved_percentage = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] rpc_response_timeout = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] run_external_periodic_tasks = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] scst_target_driver = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_down_time = 720 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] shell_completion = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] snapshot_name_template = snapshot-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] state_path = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] storage_availability_zone = nova {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] storage_protocol = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] syslog_log_facility = LOG_USER {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_helper = lioadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_ip_address = 192.168.122.65 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_protocol = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] target_secondary_ip_addresses = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] transport_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] until_refresh = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_chap_auth = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_default_quota_class = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_journal = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_json = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_stderr = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] use_syslog = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] verify_glance_signatures = enabled {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_api_class = cinder.volume.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_clear = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_clear_size = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_copy_bps_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_dd_blocksize = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_name_template = volume-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_service_inithost_offload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volume_usage_audit_period = month {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] zoning_mode = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_concurrency.disable_process_locking = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.auth_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.include_service_catalog = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.interface = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcache_username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.service_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.backend = dogpile.cache.null {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.backend_argument = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.backend_expiration_time = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.config_prefix = cache.oslo {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.debug_cache_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86532) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:03:02 devstack cinder-volume[86532]: WARNING cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:03:02 devstack cinder-volume[86532]: WARNING cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.enable_retry_client = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.enable_socket_keepalive = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Running cmd (subprocess): mount.quobyte {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.expiration_time = 600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.hashclient_retry_attempts = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_dead_retry = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_pool_maxsize = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_sasl_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.proxies = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.redis_db = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.redis_server = localhost:6379 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.retry_attempts = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.retry_delay = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.socket_keepalive_count = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.socket_keepalive_idle = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.socket_keepalive_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.socket_timeout = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.tls_allowed_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.tls_cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.tls_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.tls_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.tls_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cache.username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] coordination.backend_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.asyncio_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.asyncio_slave_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.backend = sqlalchemy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.connection_debug = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.connection_parameters = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.connection_recycle_time = 3600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.connection_trace = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.db_inc_retry_interval = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.db_max_retries = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.db_max_retry_interval = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.db_retry_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.max_overflow = 50 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.max_pool_size = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.max_retries = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.mysql_wsrep_sync_wait = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.pool_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.retry_interval = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.slave_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.sqlite_synchronous = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.synchronous_reader = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] database.use_db_reconnect = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_tracing.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.connection_string = messaging:// {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.es_doc_type = notification {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.es_scroll_size = 10000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.es_scroll_time = 2m {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.filter_error_trace = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.hmac_keys = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.socket_timeout = 0.1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.trace_requests = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler.trace_sqlalchemy = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler_jaeger.process_tags = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler_jaeger.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] profiler_otlp.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.enforce_new_defaults = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.policy_default_rule = default {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.policy_file = policy.yaml {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.group = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] privsep_osbrick.user = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.group = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] cinder_sys_admin.user = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.send_service_user_token = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.tls_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] service_user.tls_min_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.tls_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] glance.tls_min_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.chap_username = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.driver_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.extra_capabilities = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack quobyte-client[86537]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 16:03:02 devstack quobyte-client[86537]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iscsi_target_flags = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iscsi_write_cache = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iser_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iser_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_host = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_login = admin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_mount_options = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_private_key = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_share_path = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=86532) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.num_shell_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: INFO cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 ... Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f -c /etc/quobyte/client-cinder.cfg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.quobyte_volume_url = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.report_discard_supported = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.reserved_percentage = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_protocol = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.unique_fqdn_network = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.use_chap_auth = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_clear = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_clear_size = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_reports.file_event_handler = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_reports.log_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.backend_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.chap_username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.chiscsi_conf = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.driver_use_ssl = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.extra_capabilities = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iser_helper = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iser_ip_address = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iser_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.iser_target_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_login = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_mount_options = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_private_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_share_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_ssh_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.num_shell_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.nvmet_port_id = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.report_discard_supported = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.reserved_percentage = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.scst_target_driver = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.storage_protocol = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_helper = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_ip_address = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_protocol = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.use_chap_auth = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f -c /etc/quobyte/client-cinder.cfg Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_clear = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_clear_size = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] QuobyteHD.volumes_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_notifications.driver = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_notifications.retry = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] key_manager.fixed_key = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.barbican_api_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.barbican_endpoint = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.barbican_endpoint_type = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.barbican_region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.number_of_retries = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.retry_delay = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.send_service_user_token = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.tls_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.tls_min_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.verify_ssl = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican.verify_ssl_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.auth_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.tls_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] barbican_service_user.tls_min_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.approle_role_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.approle_secret_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.auth_method = approle {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.auth_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.kv_mountpoint = secret {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.kv_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.kv_version = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.root_token_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.ssl_ca_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.token_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.token_role = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:03:03 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.496s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:03 devstack cinder-volume[86532]: INFO cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 succeeded Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=86532) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.517s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:03 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:03 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:03 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.306s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:03 devstack cinder-volume[86532]: INFO cinder.volume.driver [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.volume.driver [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3254661560059, 'free_capacity_gb': 1775.3254661560059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86532) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_db.sqlalchemy.engines [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86532) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG dbcounter [-] [86532] Writer thread running {{(pid=86532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.db.api [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Building query based on filter {{(pid=86532) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.image.image_utils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86532) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 16:03:03 devstack cinder-volume[86532]: INFO cinder.keymgr.migration [None req-38628d19-760a-4595-a9d9-070154171768 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=86532) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=86532) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:03 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:03 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:03 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.304s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:03 devstack cinder-volume[86532]: DEBUG cinder.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Notifying Schedulers of capabilities ... {{(pid=86532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:04 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Driver initialization completed successfully. Sep 25 16:03:04 devstack cinder-volume[86532]: INFO cinder.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Initiating service 3 cleanup Sep 25 16:03:04 devstack cinder-volume[86532]: INFO cinder.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Service 3 cleanup completed. Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG cinder.service [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Creating RPC server for service cinder-volume {{(pid=86532) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG cinder.service [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86532) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:03:04 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=86532) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=86532) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:04 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:04 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:04 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:04 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.320s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:04 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-c0fae983-16e2-4c45-ae5e-30ea54998d9c None None] Driver post RPC initialization completed successfully. Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=86532) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG cinder.volume.drivers.quobyte [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=86532) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86532) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:09 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:09 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:09 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG oslo_concurrency.processutils [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.283s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:09 devstack cinder-volume[86532]: DEBUG cinder.manager [None req-58718275-6efb-41a6-a827-78f98c803d81 None None] Notifying Schedulers of capabilities ... {{(pid=86532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:12 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Caught SIGTERM, stopping children Sep 25 16:03:12 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:12 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:12 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:12 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Stop services. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:03:12 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Killing children. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:03:12 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Waiting on 1 children to exit Sep 25 16:03:14 devstack cinder-volume[86532]: DEBUG dbcounter [-] [86532] Writing DB stats cinder:SELECT=3 {{(pid=86532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:14 devstack cinder-volume[86532]: DEBUG dbcounter [-] [86532] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:17 devstack cinder-volume[86532]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 16:03:17 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Acquiring lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:17 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Acquired lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:17 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Releasing lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:17 devstack cinder-volume[86532]: WARNING amqp [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:17 devstack cinder-volume[86532]: WARNING amqp [None req-83029666-bb2c-40ac-b5c5-cd860dca8619 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:17 devstack cinder-volume[86889]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:03:17 devstack cinder-volume[86889]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:03:17 devstack cinder-volume[86889]: we strongly recommend against using it for new projects. Sep 25 16:03:17 devstack cinder-volume[86889]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:03:17 devstack cinder-volume[86889]: framework. For more detail see Sep 25 16:03:17 devstack cinder-volume[86889]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:03:17 devstack cinder-volume[86889]: import eventlet # noqa Sep 25 16:03:20 devstack cinder-volume[86889]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:20 devstack cinder-volume[86889]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:20 devstack cinder-volume[86889]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:21 devstack cinder-volume[86889]: INFO dbcounter [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Registered counter for database cinder Sep 25 16:03:21 devstack cinder-volume[86889]: DEBUG oslo_db.sqlalchemy.engines [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG dbcounter [-] [86889] Writer thread running {{(pid=86889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:22 devstack cinder-volume[86889]: INFO cinder.rpc [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:03:22 devstack cinder-volume[86889]: INFO cinder.rpc [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_db.sqlalchemy.engines [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:22 devstack cinder-volume[86889]: INFO cinder.volume.manager [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Determined volume DB was empty at startup. Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG cinder.volume.manager [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86889) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:03:22 devstack cinder-volume[86889]: WARNING stevedore.named [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:03:22 devstack cinder-volume[86889]: WARNING castellan.key_manager [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:22 devstack cinder-volume[86889]: WARNING cinder.keymgr.conf_key_mgr [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:22 devstack cinder-volume[86889]: INFO cinder.volume.manager [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_db.sqlalchemy.engines [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:22 devstack cinder-volume[86889]: INFO oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Starting 1 workers Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Started child 87199 {{(pid=86889) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Full set of CONF: {{(pid=86889) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] ******************************************************************************** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] Configuration options gathered from: {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] ================================================================================ {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:03:22 devstack cinder-volume[87199]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] allow_availability_zone_fallback = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] allow_compression_on_image_upload = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] allowed_direct_url_schemes = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] api_rate_limit = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] auth_strategy = keystone {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_availability_zone = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_host = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_stats_polling_interval = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backup_api_class = cinder.backup.api.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backup_name_template = backup-%s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backup_use_same_host = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backup_use_temp_snapshot = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] chap_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] chap_username = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_internal_tenant_project_id = 00c2db976f0c49319a71adeafba01c94 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_internal_tenant_user_id = 668bb62493884c5789fae31946349df9 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cluster = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] compression_format = gzip {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] compute_api_class = cinder.compute.nova.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] config_dir = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] config_source = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] control_exchange = openstack {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] debug = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] default_availability_zone = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] default_group_type = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] default_volume_type = QuobyteHD {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] disk_geometry = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_client_cert = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_client_cert_key = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_data_namespace = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_ssl_cert_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_ssl_cert_verify = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] driver_use_ssl = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] enable_new_services = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] enable_unsupported_driver = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] enabled_backends = ['QuobyteHD'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] enforce_multipath_for_image_xfer = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] filter_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_api_insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_api_ssl_compression = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_ca_certificates_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_catalog_info = image:glance:publicURL {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_num_retries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance_request_timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] goodness_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] graceful_shutdown_timeout = 5 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] group_api_class = cinder.group.api.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] host = devstack {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_compress_on_upload = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_conversion_address_space_limit = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_conversion_cpu_limit = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_conversion_disable = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_introspection_address_space_limit = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_introspection_cpu_limit = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_upload_use_cinder_backend = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_upload_use_internal_tenant = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_volume_cache_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_volume_cache_max_count = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] image_volume_cache_max_size_gb = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] init_host_max_objects_retrieval = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] instance_format = [instance: %(uuid)s] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87199) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iscsi_target_flags = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iscsi_write_cache = on {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iser_helper = tgtadm {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iser_ip_address = 192.168.122.65 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iser_port = 3260 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_color = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_config_append = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_dir = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_options = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_rotate_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_rotate_interval_type = days {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] log_rotation_type = none {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] max_age = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] max_logfile_count = 30 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] max_logfile_size_mb = 200 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] max_over_subscription_ratio = 20.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] message_reap_interval = 86400 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] message_ttl = 2592000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] migration_create_volume_timeout_secs = 300 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] monkey_patch = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] monkey_patch_modules = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] my_ip = 192.168.122.65 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] no_snapshot_gb_quota = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] num_iser_scan_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] num_shell_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] num_volume_device_scan_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] nvmeof_conn_info_version = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] nvmet_ns_id = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] nvmet_port_id = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_max_limit = 1000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_ext_list = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_listen_port = 8776 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_use_ssl = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] osapi_volume_workers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] per_volume_size_limit = -1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] periodic_fuzzy_delay = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] periodic_interval = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] public_endpoint = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] publish_errors = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_backup_gigabytes = 1000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_backups = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_gigabytes = 1000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_groups = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_snapshots = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] quota_volumes = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] rate_limit_burst = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] rate_limit_except_level = CRITICAL {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] rate_limit_interval = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] reinit_driver_count = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] replication_device = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] report_discard_supported = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] report_interval = 120 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] reservation_clean_interval = 86400 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] reservation_expire = 86400 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] reserved_image_namespaces = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] reserved_percentage = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] rpc_response_timeout = 120 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] run_external_periodic_tasks = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] scst_target_driver = iscsi {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] scst_target_iqn_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_down_time = 720 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] shell_completion = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] snapshot_name_template = snapshot-%s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] split_loggers = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] state_path = /opt/stack/data/cinder {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] storage_availability_zone = nova {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] storage_protocol = iSCSI {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] syslog_log_facility = LOG_USER {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_helper = lioadm {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_ip_address = 192.168.122.65 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_port = 3260 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_protocol = iscsi {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] target_secondary_ip_addresses = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] trace_flags = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] transport_url = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] until_refresh = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_chap_auth = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_default_quota_class = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_journal = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_json = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_multipath_for_image_xfer = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_stderr = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] use_syslog = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] verify_glance_signatures = enabled {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_api_class = cinder.volume.api.API {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_backend_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_clear = zero {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_clear_ionice = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_clear_size = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_copy_bps_limit = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_dd_blocksize = 1M {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_name_template = volume-%s {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_service_inithost_offload = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volume_usage_audit_period = month {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] zoning_mode = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_concurrency.disable_process_locking = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.auth_section = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87199) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.auth_type = password {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:03:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.auth_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.cache = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Running cmd (subprocess): mount.quobyte {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.include_service_catalog = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.interface = public {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcache_username = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.region_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.service_type = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.backend = dogpile.cache.null {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.backend_argument = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.backend_expiration_time = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.config_prefix = cache.oslo {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.debug_cache_backend = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.enable_retry_client = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.enable_socket_keepalive = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.expiration_time = 600 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.hashclient_retry_attempts = 2 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_dead_retry = 300 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_pool_maxsize = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_sasl_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.proxies = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.redis_db = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.redis_server = localhost:6379 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.retry_attempts = 2 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.retry_delay = 0.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.socket_keepalive_count = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.socket_keepalive_idle = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.socket_keepalive_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.socket_timeout = 1.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.tls_allowed_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.tls_cafile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.tls_certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.tls_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.tls_keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cache.username = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] coordination.backend_url = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.asyncio_connection = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.asyncio_slave_connection = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.backend = sqlalchemy {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.connection = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.connection_debug = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.connection_parameters = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.connection_recycle_time = 3600 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.connection_trace = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.db_inc_retry_interval = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.db_max_retries = 20 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.db_max_retry_interval = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.db_retry_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.max_overflow = 50 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.max_pool_size = 5 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.max_retries = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.mysql_wsrep_sync_wait = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.pool_timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.retry_interval = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.slave_connection = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.sqlite_synchronous = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.synchronous_reader = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] database.use_db_reconnect = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_tracing.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.connection_string = messaging:// {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.es_doc_type = notification {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.es_scroll_size = 10000 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.es_scroll_time = 2m {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.filter_error_trace = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.hmac_keys = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.sentinel_service_name = mymaster {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.socket_timeout = 0.1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.trace_requests = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler.trace_sqlalchemy = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler_jaeger.process_tags = {} {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler_jaeger.service_name_prefix = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] profiler_otlp.service_name_prefix = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.enforce_new_defaults = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.policy_default_rule = default {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack quobyte-client[87200]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.policy_file = policy.yaml {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack quobyte-client[87200]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.group = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.helper_command = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] privsep_osbrick.user = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.group = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.helper_command = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] cinder_sys_admin.user = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.auth_section = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.auth_type = password {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.cafile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.collect_timing = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.send_service_user_token = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.split_loggers = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.tls_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] service_user.tls_min_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.auth_section = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.auth_type = password {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.collect_timing = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.region_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.split_loggers = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.tls_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] glance.tls_min_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.backend_availability_zone = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.chap_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.chap_username = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.disk_geometry = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_client_cert = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_client_cert_key = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_data_namespace = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.driver_use_ssl = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.extra_capabilities = {} {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.filter_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.goodness_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iscsi_target_flags = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iscsi_write_cache = on {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iser_helper = tgtadm {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iser_port = 3260 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_host = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_login = admin {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_mount_options = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_private_key = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_share_path = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.num_shell_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.quobyte_volume_url = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.replication_device = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.report_discard_supported = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.reserved_percentage = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_helper = tgtadm {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_port = 3260 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_protocol = iscsi {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.trace_flags = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.unique_fqdn_network = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.use_chap_auth = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_backend_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_clear = zero {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_clear_ionice = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_clear_size = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_reports.file_event_handler = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_reports.log_dir = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.backend_availability_zone = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.backend_host = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.chap_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.chap_username = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.chiscsi_conf = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.disk_geometry = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_client_cert = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_data_namespace = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.driver_use_ssl = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.extra_capabilities = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.filter_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.goodness_function = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iser_helper = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iser_ip_address = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iser_port = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.iser_target_prefix = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_host = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_login = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_mount_options = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_password = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_private_key = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_share_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_ssh_port = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.num_shell_tries = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.nvmet_port_id = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.replication_device = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.report_discard_supported = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.reserved_percentage = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.scst_target_driver = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.storage_protocol = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_helper = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_ip_address = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_port = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_prefix = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_protocol = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.trace_flags = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.use_chap_auth = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_clear = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_clear_size = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] QuobyteHD.volumes_dir = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_notifications.driver = [] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_notifications.retry = -1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] key_manager.fixed_key = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.barbican_api_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.barbican_endpoint = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.barbican_endpoint_type = public {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.barbican_region_name = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.cafile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.collect_timing = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.number_of_retries = 60 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.retry_delay = 1 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.send_service_user_token = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.split_loggers = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.tls_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.tls_min_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.verify_ssl = True {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican.verify_ssl_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.auth_section = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.auth_type = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.cafile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.certfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.collect_timing = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.insecure = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.keyfile = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.split_loggers = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.timeout = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.tls_ciphers = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] barbican_service_user.tls_min_version = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.approle_role_id = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.approle_secret_id = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.auth_method = approle {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.auth_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.kv_mountpoint = secret {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.kv_path = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.kv_version = 2 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.namespace = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.root_token_id = **** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.ssl_ca_crt_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.timeout = 60.0 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.token_file = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.token_role = None {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.use_ssl = False {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:22 devstack cinder-volume[86889]: DEBUG oslo_service.backend._eventlet.service [None req-d20554c2-0ab4-4a25-8e54-e6eccf24330f None None] ******************************************************************************** {{(pid=86889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:03:23 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.311s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.volume.driver [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.volume.driver [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_db.sqlalchemy.engines [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writer thread running {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.db.api [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Building query based on filter {{(pid=87199) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87199) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.keymgr.migration [None req-9f6f2fd5-f523-46de-ba5c-6e1402597292 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:03:23 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:23 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:23 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.293s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Driver initialization completed successfully. Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Initiating service 3 cleanup Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Service 3 cleanup completed. Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.service [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Creating RPC server for service cinder-volume {{(pid=87199) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.service [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87199) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:03:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:23 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:03:23 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:24 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.304s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9b43791e-ce31-4d23-9ef9-b2170637c75c None None] Driver post RPC initialization completed successfully. Sep 25 16:03:32 devstack cinder-volume[86889]: DEBUG dbcounter [-] [86889] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:34 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:04:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 6 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:04:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Flow 'volume_create_manager' (1c59f7f4-802b-4f45-a909-5c43ea1c7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfbeec-4a9a-4e99-a8c0-46e31554af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfbeec-4a9a-4e99-a8c0-46e31554af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-8359474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141dafc7-e2b0-4ba4-a030-ed7a0c70dec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaad4263744b0ca3ce51e72668837a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:35Z,use_quota=True,user_id='5e936cc744e14212989bd7d087e14a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625ff2f1-7f7f-4f8e-8865-360174b489e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625ff2f1-7f7f-4f8e-8865-360174b489e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47980c5e-89d6-4b97-b58a-1f9d2e361d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47980c5e-89d6-4b97-b58a-1f9d2e361d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141dafc7-e2b0-4ba4-a030-ed7a0c70dec2', 'volume_name': 'volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de467e2-a47a-4610-ba4d-c601aec47a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de467e2-a47a-4610-ba4d-c601aec47a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b77b4-7d2a-46fa-874d-8625ed9decb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Volume 141dafc7-e2b0-4ba4-a030-ed7a0c70dec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2', 'volume_size': 1} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-8359474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141dafc7-e2b0-4ba4-a030-ed7a0c70dec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaad4263744b0ca3ce51e72668837a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:35Z,use_quota=True,user_id='5e936cc744e14212989bd7d087e14a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Creating volume 141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:04:35 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:04:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:35 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 1073741824 Sep 25 16:04:35 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:36 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 1073741824" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:36 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 Sep 25 16:04:36 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:36 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" returned: 0 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b77b4-7d2a-46fa-874d-8625ed9decb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bfbdd8-fe79-4574-b32b-4c37a955cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Volume volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 (141dafc7-e2b0-4ba4-a030-ed7a0c70dec2): created successfully Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bfbdd8-fe79-4574-b32b-4c37a955cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Flow 'volume_create_manager' (1c59f7f4-802b-4f45-a909-5c43ea1c7799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d4f4ec0b-68b7-4f07-a6f9-a79b27553409 tempest-TaggedAttachmentsTest-571483572 None] Created volume successfully. Sep 25 16:04:46 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:47 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=1,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Flow 'volume_create_manager' (7dc3107a-58c2-4d2c-b8c2-8c9736409e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4b5369-3a7b-443c-9944-a9dae5bcf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4b5369-3a7b-443c-9944-a9dae5bcf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744237269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbba38fb-f1db-4843-9c8b-e866bea7199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e8a499bfda4efaa21b795373081661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:05Z,use_quota=True,user_id='413cf74aa41a495d9ba19d3be61624dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a776b603-0856-4825-a7ec-87a47c8eecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a776b603-0856-4825-a7ec-87a47c8eecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900915a9-0c35-4bbe-bb16-bd013f01787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900915a9-0c35-4bbe-bb16-bd013f01787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbba38fb-f1db-4843-9c8b-e866bea7199b', 'volume_name': 'volume-fbba38fb-f1db-4843-9c8b-e866bea7199b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d164dc6-a2d0-414d-b626-9b6f10d92d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d164dc6-a2d0-414d-b626-9b6f10d92d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49872ae-8839-4c10-882a-6aa3d617430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Volume fbba38fb-f1db-4843-9c8b-e866bea7199b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbba38fb-f1db-4843-9c8b-e866bea7199b', 'volume_size': 1} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744237269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbba38fb-f1db-4843-9c8b-e866bea7199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e8a499bfda4efaa21b795373081661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:05Z,use_quota=True,user_id='413cf74aa41a495d9ba19d3be61624dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Creating volume fbba38fb-f1db-4843-9c8b-e866bea7199b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:05:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:04 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b 1073741824 Sep 25 16:05:04 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:06 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:05:06 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:06 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b 1073741824" returned: 0 in 1.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:06 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b Sep 25 16:05:06 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:06 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.488s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 6 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:05:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:05:07 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b" returned: 0 in 0.856s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49872ae-8839-4c10-882a-6aa3d617430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbba38fb-f1db-4843-9c8b-e866bea7199b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dd850-e7fc-48f6-b07c-3f96a9bad0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Volume volume-fbba38fb-f1db-4843-9c8b-e866bea7199b (fbba38fb-f1db-4843-9c8b-e866bea7199b): created successfully Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dd850-e7fc-48f6-b07c-3f96a9bad0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Flow 'volume_create_manager' (7dc3107a-58c2-4d2c-b8c2-8c9736409e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f715ff71-d824-4796-9840-f568a77491e5 tempest-DeleteServersTestJSON-1464817777 None] Created volume successfully. Sep 25 16:05:17 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:17 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:17 devstack cinder-volume[87199]: WARNING py.warnings [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 25 16:05:17 devstack cinder-volume[87199]: .first() Sep 25 16:05:17 devstack cinder-volume[87199]: Sep 25 16:05:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-fbba38fb-f1db-4843-9c8b-e866bea7199b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7b2d0d9-a3f8-4fb7-9c90-d5c3e4084e0f', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Flow 'volume_create_manager' (e4cee4b6-36b9-40e8-b06e-fe52d31d24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96049a21-77ea-4801-935c-4a1dbd2af172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96049a21-77ea-4801-935c-4a1dbd2af172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1095613667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380bf843-9daf-4ee3-9737-b32421e05150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f689a0bac964166be5ad867ee12d2ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:18Z,use_quota=True,user_id='47f8fed376274a799a9a52814bc600c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1165f465-26a8-4af7-a4c7-df9dfb253913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1165f465-26a8-4af7-a4c7-df9dfb253913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93df5ca1-542e-4b01-b8a8-fca7a1a217ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93df5ca1-542e-4b01-b8a8-fca7a1a217ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380bf843-9daf-4ee3-9737-b32421e05150', 'volume_name': 'volume-380bf843-9daf-4ee3-9737-b32421e05150', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183a10ea-747e-470f-ac91-77e331b1d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183a10ea-747e-470f-ac91-77e331b1d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bb507a-63b8-4bea-9c2e-d13a2eb6aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Volume 380bf843-9daf-4ee3-9737-b32421e05150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380bf843-9daf-4ee3-9737-b32421e05150', 'volume_size': 1} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1095613667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380bf843-9daf-4ee3-9737-b32421e05150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f689a0bac964166be5ad867ee12d2ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:18Z,use_quota=True,user_id='47f8fed376274a799a9a52814bc600c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Creating volume 380bf843-9daf-4ee3-9737-b32421e05150 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:05:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ce41f63a-8289-48f4-8f16-6630c1d0f72c req-e3b36bdd-ea9d-41c9-af45-0422e9cb47ae tempest-DeleteServersTestJSON-1464817777 None] attachment_update completed successfully. Sep 25 16:05:18 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 1073741824 Sep 25 16:05:18 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:20 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 1073741824" returned: 0 in 1.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:20 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 Sep 25 16:05:20 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:21 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150" returned: 0 in 0.625s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bb507a-63b8-4bea-9c2e-d13a2eb6aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380bf843-9daf-4ee3-9737-b32421e05150', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df1215-335c-40e9-8e94-234df9ac75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Volume volume-380bf843-9daf-4ee3-9737-b32421e05150 (380bf843-9daf-4ee3-9737-b32421e05150): created successfully Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df1215-335c-40e9-8e94-234df9ac75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Flow 'volume_create_manager' (e4cee4b6-36b9-40e8-b06e-fe52d31d24d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-77d1ba03-e56a-4939-8d22-97645edad13b tempest-VolumesAdminNegativeTest-705994855 None] Created volume successfully. Sep 25 16:05:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Acquiring lock "cinder-380bf843-9daf-4ee3-9737-b32421e05150-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "cinder-380bf843-9daf-4ee3-9737-b32421e05150-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Acquiring lock "cinder-quobyte-380bf843-9daf-4ee3-9737-b32421e05150" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "cinder-quobyte-380bf843-9daf-4ee3-9737-b32421e05150" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:23 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptlu7abfv/privsep.sock'] Sep 25 16:05:23 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptlu7abfv/privsep.sock Sep 25 16:05:23 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:05:26 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 16:05:26 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:26 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Spawned new privsep daemon via rootwrap Sep 25 16:05:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Accepted privsep connection to /tmp/tmptlu7abfv/privsep.sock {{(pid=87199) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 16:05:26 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 16:05:26 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 16:05:26 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 16:05:26 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88968 Sep 25 16:05:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6d35b-1eb5-46d8-be71-8efa43e9fd3a]: (2,) {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b2c75-737a-44f3-80aa-f887a99989fb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:27 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 Sep 25 16:05:27 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:27 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150" returned: 0 in 0.720s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:27 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150 Sep 25 16:05:27 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:28 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-380bf843-9daf-4ee3-9737-b32421e05150" returned: 0 in 0.628s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "cinder-quobyte-380bf843-9daf-4ee3-9737-b32421e05150" released by "delete_volume" :: held 4.925s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:28 devstack cinder-volume[87199]: WARNING cinder.quota [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:28 devstack cinder-volume[87199]: WARNING cinder.quota [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Created reservations ['4f668fa4-33c3-4f3a-8345-d2feffab1631', '4d62deff-4ee8-402f-b3a6-858cb49b6bb8', '5baccab5-f067-4c0a-ada3-2e2ce1e2c20b', '5cebf251-afd0-46e1-a95e-61bc65a7423b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:29 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:05:29 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ec495691-2820-499c-b4f6-ff03add26be5 req-7367948e-16d9-49d2-8f84-eeaffd6272de tempest-DeleteServersTestJSON-1464817777 None] Terminate volume connection completed successfully. Sep 25 16:05:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ec495691-2820-499c-b4f6-ff03add26be5 req-7367948e-16d9-49d2-8f84-eeaffd6272de tempest-DeleteServersTestJSON-1464817777 None] Deleting attachment c7b2d0d9-a3f8-4fb7-9c90-d5c3e4084e0f. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:05:30 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 1.137s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Deleted volume successfully. Sep 25 16:05:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cae35c99-90ad-4b67-8188-afd5a52a618e tempest-VolumesAdminNegativeTest-705994855 None] Lock "cinder-380bf843-9daf-4ee3-9737-b32421e05150-delete_volume" released by "delete_volume" :: held 7.016s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "cinder-fbba38fb-f1db-4843-9c8b-e866bea7199b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "cinder-fbba38fb-f1db-4843-9c8b-e866bea7199b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "cinder-quobyte-fbba38fb-f1db-4843-9c8b-e866bea7199b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "cinder-quobyte-fbba38fb-f1db-4843-9c8b-e866bea7199b" acquired by "delete_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b32fcfc-8398-423e-98b4-3e9b34633919]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:33 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b Sep 25 16:05:33 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:33 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b" returned: 0 in 0.668s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:33 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b Sep 25 16:05:33 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:34 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbba38fb-f1db-4843-9c8b-e866bea7199b" returned: 0 in 0.678s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "cinder-quobyte-fbba38fb-f1db-4843-9c8b-e866bea7199b" released by "delete_volume" :: held 1.463s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Created reservations ['175db547-ec58-4e88-ac00-81a6230823a4', '900f4e73-4d95-4323-93aa-a38bad36216a', 'fb37e649-18d6-46a1-8a0d-2a600ce731b8', 'c372da43-5cd0-48e9-8778-3a2a32ad5d5e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:34 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:05:34 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:34 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.295s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Deleted volume successfully. Sep 25 16:05:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f7126978-0f3e-4773-8dae-b27af016e3d8 tempest-DeleteServersTestJSON-1464817777 None] Lock "cinder-fbba38fb-f1db-4843-9c8b-e866bea7199b-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:44 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:44 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=20,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:06 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:06:06 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:06 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.388s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:06:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:06:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e1d10444-15b9-4f00-8363-fca7a140da66 req-e485cb72-85e8-46df-a69a-2eba25da23db tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e1d10444-15b9-4f00-8363-fca7a140da66 req-e485cb72-85e8-46df-a69a-2eba25da23db tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e1d10444-15b9-4f00-8363-fca7a140da66 req-e485cb72-85e8-46df-a69a-2eba25da23db tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e1d10444-15b9-4f00-8363-fca7a140da66 req-e485cb72-85e8-46df-a69a-2eba25da23db tempest-TaggedAttachmentsTest-571483572 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '217a102b-a2d6-4126-90e2-6105dd5058aa', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:06:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-e1d10444-15b9-4f00-8363-fca7a140da66 req-e485cb72-85e8-46df-a69a-2eba25da23db tempest-TaggedAttachmentsTest-571483572 None] attachment_update completed successfully. Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (5bac9ef2-8a34-4936-a61c-e65596a2222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea70089-30a4-4df8-ba5d-94d4cf32e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea70089-30a4-4df8-ba5d-94d4cf32e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-914865124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e8b826-97d5-42cc-8d97-dc862b6f0226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:21Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5607f808-9f34-4868-bf47-5a957297b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5607f808-9f34-4868-bf47-5a957297b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffff4c4e-5f40-432d-b6a0-500486c249dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffff4c4e-5f40-432d-b6a0-500486c249dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e8b826-97d5-42cc-8d97-dc862b6f0226', 'volume_name': 'volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bab7ec-2891-4d2d-b094-dbc221e23217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bab7ec-2891-4d2d-b094-dbc221e23217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe53cc-e616-4275-83a8-7108cd52e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Volume a4e8b826-97d5-42cc-8d97-dc862b6f0226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226', 'volume_size': 1} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-914865124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e8b826-97d5-42cc-8d97-dc862b6f0226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:21Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Creating volume a4e8b826-97d5-42cc-8d97-dc862b6f0226 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:21 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:06:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:21 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 1073741824 Sep 25 16:06:21 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:22 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 1073741824" returned: 0 in 1.070s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:22 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 Sep 25 16:06:22 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:23 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe53cc-e616-4275-83a8-7108cd52e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a343ae-e44a-419d-a69f-2a07061aaf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Volume volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 (a4e8b826-97d5-42cc-8d97-dc862b6f0226): created successfully Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a343ae-e44a-419d-a69f-2a07061aaf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (5bac9ef2-8a34-4936-a61c-e65596a2222b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-35df3e14-0610-463c-bd36-63d6db6d2355 tempest-VolumesTestJSON-1739822060 None] Created volume successfully. Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (20d46aaf-ebde-4b11-a491-95dc025ec66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e482ffb1-ad1f-48f4-a88e-3df778c739c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e482ffb1-ad1f-48f4-a88e-3df778c739c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1980580969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15714822-38b1-4617-86ab-7bdb1ce70314,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:26Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe277c4e-a810-4063-9272-a21fcb0f10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe277c4e-a810-4063-9272-a21fcb0f10d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678dc997-4e5a-4bb1-a684-2d835000ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678dc997-4e5a-4bb1-a684-2d835000ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15714822-38b1-4617-86ab-7bdb1ce70314', 'volume_name': 'volume-15714822-38b1-4617-86ab-7bdb1ce70314', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08461cbd-b7d1-4d9a-b22b-e8e7b4afecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08461cbd-b7d1-4d9a-b22b-e8e7b4afecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623a06e-c5f1-413d-adad-662000d9e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Volume 15714822-38b1-4617-86ab-7bdb1ce70314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15714822-38b1-4617-86ab-7bdb1ce70314', 'volume_size': 1} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1980580969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15714822-38b1-4617-86ab-7bdb1ce70314,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:26Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Creating volume 15714822-38b1-4617-86ab-7bdb1ce70314 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:26 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:06:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:26 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 1073741824 Sep 25 16:06:26 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-09e0e042-346c-49f0-b788-9b36e2c987ac req-cb46f605-f688-45d5-9ad9-c0fa90f6fe41 tempest-TaggedAttachmentsTest-571483572 None] Terminate volume connection completed successfully. Sep 25 16:06:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-09e0e042-346c-49f0-b788-9b36e2c987ac req-cb46f605-f688-45d5-9ad9-c0fa90f6fe41 tempest-TaggedAttachmentsTest-571483572 None] Deleting attachment 217a102b-a2d6-4126-90e2-6105dd5058aa. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:06:27 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 1073741824" returned: 0 in 1.295s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:28 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 Sep 25 16:06:28 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:28 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314" returned: 0 in 0.852s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623a06e-c5f1-413d-adad-662000d9e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15714822-38b1-4617-86ab-7bdb1ce70314', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec98bb1b-fa79-41a9-896e-324a92ee0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Volume volume-15714822-38b1-4617-86ab-7bdb1ce70314 (15714822-38b1-4617-86ab-7bdb1ce70314): created successfully Sep 25 16:06:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec98bb1b-fa79-41a9-896e-324a92ee0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (20d46aaf-ebde-4b11-a491-95dc025ec66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6b6b65e7-fc8c-4382-9325-5cc2e0a6efab tempest-VolumesTestJSON-1739822060 None] Created volume successfully. Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (a26a30b7-026b-4bef-9f04-a8824d463f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0cb5d2-5061-48c3-83bc-e1f3e070a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0cb5d2-5061-48c3-83bc-e1f3e070a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051322359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bbdd0d-5b9e-4bde-a782-05a0ef0358de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:32Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20fd275-44d7-4071-9a20-87383fb79766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20fd275-44d7-4071-9a20-87383fb79766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfd48f9-c178-4227-90d8-fd4c079db34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfd48f9-c178-4227-90d8-fd4c079db34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6bbdd0d-5b9e-4bde-a782-05a0ef0358de', 'volume_name': 'volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb372e92-de45-4243-8a53-ff174d33df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb372e92-de45-4243-8a53-ff174d33df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938b439a-844e-4529-b922-62acae92f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Volume f6bbdd0d-5b9e-4bde-a782-05a0ef0358de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de', 'volume_size': 1} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051322359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bbdd0d-5b9e-4bde-a782-05a0ef0358de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8140674fea04cd1aa60ab39a63363c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:32Z,use_quota=True,user_id='e63c1f88bf0c4dba94bd86a2e3ebad11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Creating volume f6bbdd0d-5b9e-4bde-a782-05a0ef0358de {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:06:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:32 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de 1073741824 Sep 25 16:06:32 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:33 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de 1073741824" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:33 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de Sep 25 16:06:33 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:34 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" returned: 0 in 0.685s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938b439a-844e-4529-b922-62acae92f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185264a8-75d7-4eeb-a2bf-65c99a198e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Volume volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de (f6bbdd0d-5b9e-4bde-a782-05a0ef0358de): created successfully Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185264a8-75d7-4eeb-a2bf-65c99a198e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Flow 'volume_create_manager' (a26a30b7-026b-4bef-9f04-a8824d463f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-63ec33ae-2609-46e3-8690-4af4a5e8abec tempest-VolumesTestJSON-1739822060 None] Created volume successfully. Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "cinder-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-quobyte-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a63b19-d1ca-4648-b319-1c60a662a06f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:38 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de Sep 25 16:06:38 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:38 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" returned: 0 in 0.689s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:38 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de Sep 25 16:06:38 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:39 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de" released by "delete_volume" :: held 1.109s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Created reservations ['6ff58b9e-6c41-432d-b0d4-80681c2404c1', 'f6032ad0-3e36-4faa-9b72-bc3348316464', 'df22d239-fad6-488c-80f5-0bf6d3562402', '09dfbe3e-7dd9-4439-8089-0a70a23317f8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:39 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:06:39 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:39 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.472s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Deleted volume successfully. Sep 25 16:06:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8df26e0-112a-44f1-a83f-ea23c8c546ee tempest-VolumesTestJSON-1739822060 None] Lock "cinder-f6bbdd0d-5b9e-4bde-a782-05a0ef0358de-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-15714822-38b1-4617-86ab-7bdb1ce70314-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "cinder-15714822-38b1-4617-86ab-7bdb1ce70314-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-quobyte-15714822-38b1-4617-86ab-7bdb1ce70314" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-15714822-38b1-4617-86ab-7bdb1ce70314" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7d6a1-36ce-430f-afd0-000bcab5dabb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:40 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 Sep 25 16:06:40 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:41 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314" returned: 0 in 1.072s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:41 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314 Sep 25 16:06:41 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:42 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-15714822-38b1-4617-86ab-7bdb1ce70314" returned: 0 in 0.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-15714822-38b1-4617-86ab-7bdb1ce70314" released by "delete_volume" :: held 1.746s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Created reservations ['1d8e6451-1d44-4222-9a76-963c0af10f4a', '2b7b2559-40a7-4a14-a9be-bd5d4efc4d2d', '7b9d3c0a-aca4-44a7-8337-474e8c14c874', '38d50b13-6eb4-4b8e-9415-881e120d5186'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:42 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:06:42 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-a4e8b826-97d5-42cc-8d97-dc862b6f0226-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "cinder-a4e8b826-97d5-42cc-8d97-dc862b6f0226-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Acquiring lock "cinder-quobyte-a4e8b826-97d5-42cc-8d97-dc862b6f0226" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-a4e8b826-97d5-42cc-8d97-dc862b6f0226" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a4a13-7d17-4485-8d93-7997ad6e3d9d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:43 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 1.081s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Deleted volume successfully. Sep 25 16:06:43 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 Sep 25 16:06:43 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7d4eb6-66c1-4117-92f8-78b2029d111f tempest-VolumesTestJSON-1739822060 None] Lock "cinder-15714822-38b1-4617-86ab-7bdb1ce70314-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:44 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226" returned: 0 in 0.994s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:44 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226 Sep 25 16:06:44 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Flow 'volume_create_manager' (8cc6584a-73c9-46ea-8ae2-e3aadb7bf4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd9212-17e5-4600-9364-4bb58970d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd9212-17e5-4600-9364-4bb58970d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1984460746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be0e19f-1a01-4b0b-bb21-f1d73b79db65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99803afd2600454da134f8bbc05b1c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:45Z,use_quota=True,user_id='fb468e751d214bbcaa58311178275677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39585064-6007-4fdf-9d71-bf7180975113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39585064-6007-4fdf-9d71-bf7180975113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce3f4fa-eb1a-4d58-a466-29ee19769e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce3f4fa-eb1a-4d58-a466-29ee19769e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be0e19f-1a01-4b0b-bb21-f1d73b79db65', 'volume_name': 'volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480c7a89-02bb-476d-b086-461bc246243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480c7a89-02bb-476d-b086-461bc246243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db577109-0aa0-45c8-8df7-d5028487e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Volume 7be0e19f-1a01-4b0b-bb21-f1d73b79db65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65', 'volume_size': 1} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:45 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1984460746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be0e19f-1a01-4b0b-bb21-f1d73b79db65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99803afd2600454da134f8bbc05b1c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:45Z,use_quota=True,user_id='fb468e751d214bbcaa58311178275677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Creating volume 7be0e19f-1a01-4b0b-bb21-f1d73b79db65 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a4e8b826-97d5-42cc-8d97-dc862b6f0226" returned: 0 in 1.013s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "cinder-quobyte-a4e8b826-97d5-42cc-8d97-dc862b6f0226" released by "delete_volume" :: held 2.174s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:45 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 1073741824 Sep 25 16:06:45 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Created reservations ['90798eff-9900-410c-ad0b-218819f24ed0', 'b250f735-b2db-4afd-85e5-10adcf1ea421', 'a595638e-fdc6-4f68-b7b4-ce3113b328d4', 'b3a0a5b9-3c9f-4537-8967-ccc5f04b7534'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:46 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:06:46 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:46 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.447s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Deleted volume successfully. Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e0ca10d-137d-4b57-a489-7acee36b9563 tempest-VolumesTestJSON-1739822060 None] Lock "cinder-a4e8b826-97d5-42cc-8d97-dc862b6f0226-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:46 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 1073741824" returned: 0 in 1.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:47 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 Sep 25 16:06:47 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:47 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" returned: 0 in 0.691s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db577109-0aa0-45c8-8df7-d5028487e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf2d1a-b5be-4c54-b553-f0bb8bd23f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Volume volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 (7be0e19f-1a01-4b0b-bb21-f1d73b79db65): created successfully Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf2d1a-b5be-4c54-b553-f0bb8bd23f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Flow 'volume_create_manager' (8cc6584a-73c9-46ea-8ae2-e3aadb7bf4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66d4ac01-11c6-4221-9fc0-97d5fee01f65 tempest-ServerRescueNegativeTestJSON-1346450686 None] Created volume successfully. Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "cinder-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "cinder-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "cinder-quobyte-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "cinder-quobyte-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d53143-a0f1-4633-8c5c-264bc837895b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:51 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 Sep 25 16:06:51 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:51 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" returned: 0 in 0.918s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:51 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2 Sep 25 16:06:51 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:52 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" returned: 0 in 0.995s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "cinder-quobyte-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2" released by "delete_volume" :: held 2.002s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:52 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Created reservations ['0064e130-1518-4d5d-bdf8-7d27066bc623', 'ff454b18-77e0-4f03-8e0c-083d570980bb', 'f5e4b837-b270-4897-8926-d1b26f752b1d', 'a4d32c4f-edd7-4cb9-a363-4d37c0df6206'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:53 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:06:53 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:53 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.703s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Deleted volume successfully. Sep 25 16:06:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7bd05b32-e42b-4b7c-bfd8-10d6ede768d6 tempest-TaggedAttachmentsTest-571483572 None] Lock "cinder-141dafc7-e2b0-4ba4-a030-ed7a0c70dec2-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Flow 'volume_create_manager' (c0f58a74-9e28-43e7-ab0a-7f61312db40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888c642-d5b2-46c0-b892-4ccdba002346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888c642-d5b2-46c0-b892-4ccdba002346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-365158007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a0de18-a0f7-411b-ae75-0a70314e8bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a440c8a044a45a6b8e15041849f321b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:00Z,use_quota=True,user_id='74f806f3df3541b69f03055447907f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74df896-5f9b-4215-8ea6-9f11712ab621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74df896-5f9b-4215-8ea6-9f11712ab621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b6c98d-df78-42a7-b57a-40942e1b8af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b6c98d-df78-42a7-b57a-40942e1b8af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a0de18-a0f7-411b-ae75-0a70314e8bad', 'volume_name': 'volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f8e740-8526-4ca9-8166-240ee2c11170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f8e740-8526-4ca9-8166-240ee2c11170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784b6c3e-9208-4000-a4a9-73d41bbd669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Volume d7a0de18-a0f7-411b-ae75-0a70314e8bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad', 'volume_size': 1} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-365158007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a0de18-a0f7-411b-ae75-0a70314e8bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a440c8a044a45a6b8e15041849f321b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:00Z,use_quota=True,user_id='74f806f3df3541b69f03055447907f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Creating volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:00 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:07:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:00 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad 1073741824 Sep 25 16:07:00 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:01 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad 1073741824" returned: 0 in 0.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:01 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad Sep 25 16:07:01 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:01 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad" returned: 0 in 0.643s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784b6c3e-9208-4000-a4a9-73d41bbd669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4db1b1-9506-493e-90fa-6222310e3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Volume volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad (d7a0de18-a0f7-411b-ae75-0a70314e8bad): created successfully Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4db1b1-9506-493e-90fa-6222310e3f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Flow 'volume_create_manager' (c0f58a74-9e28-43e7-ab0a-7f61312db40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-adb72e46-0a1d-42b8-b846-9ff8f7e5e24c tempest-SnapshotsActionsTest-1264032763 None] Created volume successfully. Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Creating offline snapshot d850503e-7760-45e0-b3d0-ecffeb14a7c5 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[26965d7e-1bd0-4ef6-8de5-e2ee72e9511a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:02 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad Sep 25 16:07:02 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:03 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad" returned: 0 in 0.580s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:03 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 1G Sep 25 16:07:03 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:03 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 1G" returned: 0 in 0.648s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:03 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:03 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:04 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:04 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 is being set with open permissions: ugo+rw Sep 25 16:07:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:04 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:04 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:04 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.442s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:04 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info Sep 25 16:07:04 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:05 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info" returned: 0 in 0.450s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:05 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info is being set with open permissions: ugo+rw Sep 25 16:07:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:05 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info Sep 25 16:07:05 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:05 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.info" returned: 0 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-016db8e8-6427-4226-a666-f9e6bf81f2e9 tempest-SnapshotsActionsTest-1264032763 None] Create snapshot completed successfully Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:06 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:07:06 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:06 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.837s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:07:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Acquiring lock "cinder-7be0e19f-1a01-4b0b-bb21-f1d73b79db65-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "cinder-7be0e19f-1a01-4b0b-bb21-f1d73b79db65-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Acquiring lock "cinder-quobyte-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "cinder-quobyte-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf08d205-29d4-4ad6-b944-2c4d9458b513]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Creating offline snapshot 75903eb3-7c3e-44f3-a261-8715ab3e4853 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:07 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 Sep 25 16:07:07 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[597ecd7b-3be9-41aa-a2a7-29a4c47436d0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:08 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:08 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:08 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" returned: 0 in 1.024s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:08 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65 Sep 25 16:07:08 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:08 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "cinder-quobyte-7be0e19f-1a01-4b0b-bb21-f1d73b79db65" released by "delete_volume" :: held 1.733s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Created reservations ['06d71e8e-c763-4690-8e54-0838cd3b033a', '1b676f95-983e-44c6-aa4f-75233409f2c6', 'a7fbdbd6-b522-4128-85f1-d7f0eeadff4d', '98631fb0-0217-473a-82d2-171e99b85da6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:09 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 1.305s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:09 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 1G Sep 25 16:07:09 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:09 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:07:09 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:10 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 1G" returned: 0 in 0.933s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:10 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.857s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:10 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 Sep 25 16:07:10 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Deleted volume successfully. Sep 25 16:07:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e8aa103-6f52-4b09-8a83-1fa030c30ffb tempest-ServerRescueNegativeTestJSON-1346450686 None] Lock "cinder-7be0e19f-1a01-4b0b-bb21-f1d73b79db65-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:11 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853" returned: 0 in 0.935s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:11 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 is being set with open permissions: ugo+rw Sep 25 16:07:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:11 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 Sep 25 16:07:11 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:11 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.353s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cc156ef7-8bf1-4ab0-ad6f-bcb5fe3c282b tempest-SnapshotsActionsTest-1264032763 None] Create snapshot completed successfully Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Flow 'volume_create_manager' (46c1149a-0e16-4b0e-922c-360a1b07ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca76fb6-98b8-4df2-9dce-7550e212e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca76fb6-98b8-4df2-9dce-7550e212e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-74348027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcfbe7a-3450-4bbb-b721-c8b3ffda7779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14a94666fa9411eacff1162aa013060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:13Z,use_quota=True,user_id='6f63567e08e8405fb21d6364c30be270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b19c34-11a3-491e-934c-a4d96308516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b19c34-11a3-491e-934c-a4d96308516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077fd256-ef9b-41b3-8c17-63e8f3e6fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077fd256-ef9b-41b3-8c17-63e8f3e6fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'volume_name': 'volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87686f84-e262-4e85-a780-5c92a01eea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87686f84-e262-4e85-a780-5c92a01eea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db58650c-8546-4a35-aa79-26807db283dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Volume cdcfbe7a-3450-4bbb-b721-c8b3ffda7779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'volume_size': 1} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-74348027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcfbe7a-3450-4bbb-b721-c8b3ffda7779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14a94666fa9411eacff1162aa013060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:13Z,use_quota=True,user_id='6f63567e08e8405fb21d6364c30be270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Creating volume cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:13 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 1073741824 Sep 25 16:07:13 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-75903eb3-7c3e-44f3-a261-8715ab3e4853-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-75903eb3-7c3e-44f3-a261-8715ab3e4853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-75903eb3-7c3e-44f3-a261-8715ab3e4853" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-75903eb3-7c3e-44f3-a261-8715ab3e4853" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Deleting offline snapshot 75903eb3-7c3e-44f3-a261-8715ab3e4853 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] snapshot_file for this snap is: volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8457a4-405a-4459-a6b4-92de558625af]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:14 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 1073741824" returned: 0 in 0.932s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:14 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 Sep 25 16:07:14 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:14 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 Sep 25 16:07:14 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:15 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=47,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=9 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db58650c-8546-4a35-aa79-26807db283dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d974592-cd9c-4513-8c2f-19bb7dfa5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=54,cinder:UPDATE=61,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:15 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Volume volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 (cdcfbe7a-3450-4bbb-b721-c8b3ffda7779): created successfully Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d974592-cd9c-4513-8c2f-19bb7dfa5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Flow 'volume_create_manager' (46c1149a-0e16-4b0e-922c-360a1b07ff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853" returned: 0 in 1.767s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f98044f-ff72-4f4c-98be-89cf5ded5e7f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bf715b8c-4cb3-4e36-833b-9fddfb819ea3 tempest-ServerActionsTestOtherA-246211500 None] Created volume successfully. Sep 25 16:07:16 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:16 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:16 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.719s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:16 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 Sep 25 16:07:16 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:17 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:17 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853 Sep 25 16:07:17 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:17 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.75903eb3-7c3e-44f3-a261-8715ab3e4853" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-75903eb3-7c3e-44f3-a261-8715ab3e4853" released by "_delete_snapshot" :: held 3.885s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_snapshot" :: held 3.944s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:17 devstack cinder-volume[87199]: WARNING cinder.quota [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Created reservations ['d688ef74-92a3-4655-a700-115d869d5b12', '6378655c-6e2c-4869-a56d-62da5fd9b27d', '935a848c-3e1b-414a-b8bb-9890a40b4c27', 'e5c693d3-0c20-4aa1-97c9-0159a515aa52'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Delete snapshot completed successfully. Sep 25 16:07:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8a1638eb-daea-46b0-8771-216732608163 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-75903eb3-7c3e-44f3-a261-8715ab3e4853-delete_snapshot" released by "delete_snapshot" :: held 4.264s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Creating offline snapshot 98bf73f3-5c89-432c-a624-a1a111090443 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34179b-a561-44cd-9095-a9e9b2941fcd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:19 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:19 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:19 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.608s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:19 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 1G Sep 25 16:07:19 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:20 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 1G" returned: 0 in 0.907s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:20 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 Sep 25 16:07:20 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:21 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443" returned: 0 in 0.605s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 is being set with open permissions: ugo+rw Sep 25 16:07:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:21 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 Sep 25 16:07:21 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:21 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c8d16315-b543-4355-8ac9-e51d9994857b tempest-SnapshotsActionsTest-1264032763 None] Create snapshot completed successfully Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-98bf73f3-5c89-432c-a624-a1a111090443-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-98bf73f3-5c89-432c-a624-a1a111090443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-98bf73f3-5c89-432c-a624-a1a111090443" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-98bf73f3-5c89-432c-a624-a1a111090443" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Deleting offline snapshot 98bf73f3-5c89-432c-a624-a1a111090443 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] snapshot_file for this snap is: volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0e1cd-10df-4a8b-8cdb-46443e356ab2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:22 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 Sep 25 16:07:22 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443" returned: 0 in 0.615s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd30e7b-ce0a-46bd-b6a1-c8edb9db20b4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:23 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.607s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 Sep 25 16:07:23 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:24 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443" returned: 0 in 0.815s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:24 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443 Sep 25 16:07:24 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:25 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.98bf73f3-5c89-432c-a624-a1a111090443" returned: 0 in 0.498s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-98bf73f3-5c89-432c-a624-a1a111090443" released by "_delete_snapshot" :: held 2.715s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_snapshot" :: held 2.752s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Created reservations ['c2f282ee-c70e-425c-99c7-f2b38c00fa4d', 'f5472787-92a3-483a-bab3-3936c5b7c350', 'c9b8b0aa-d379-421f-9dde-4a474c82c8b0', 'e34e7c1f-15e4-46d7-8e16-ddd2e4bbae55'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Delete snapshot completed successfully. Sep 25 16:07:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ecc6ec7-a3f2-473b-ad95-cbfcf2412c1b tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-98bf73f3-5c89-432c-a624-a1a111090443-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Creating offline snapshot 9791afd5-9baf-4d92-a544-2dc9782fac57 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f988cba1-e417-4337-8ee3-8c96b5e13c80]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:26 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:26 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:26 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:26 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 1G Sep 25 16:07:26 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:27 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 1G" returned: 0 in 0.681s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:27 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 Sep 25 16:07:27 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:28 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:28 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 is being set with open permissions: ugo+rw Sep 25 16:07:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:28 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 Sep 25 16:07:28 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:28 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57" returned: 0 in 0.337s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7b47f19d-b058-4767-8a8a-5d6055335ae9 tempest-SnapshotsActionsTest-1264032763 None] Create snapshot completed successfully Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-9791afd5-9baf-4d92-a544-2dc9782fac57-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-9791afd5-9baf-4d92-a544-2dc9782fac57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-9791afd5-9baf-4d92-a544-2dc9782fac57" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-9791afd5-9baf-4d92-a544-2dc9782fac57" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Deleting offline snapshot 9791afd5-9baf-4d92-a544-2dc9782fac57 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] snapshot_file for this snap is: volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee126516-a127-4d1f-9b79-f2b0ddca6e40]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:29 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 Sep 25 16:07:29 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:30 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57" returned: 0 in 0.548s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ba5c4-4cf0-4d7d-ba13-6dbb2603fe7f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:30 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:30 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:30 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.506s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:30 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 Sep 25 16:07:30 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:31 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:31 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57 Sep 25 16:07:31 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:31 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.9791afd5-9baf-4d92-a544-2dc9782fac57" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-9791afd5-9baf-4d92-a544-2dc9782fac57" released by "_delete_snapshot" :: held 2.169s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_snapshot" :: held 2.200s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Created reservations ['d89fae5e-5272-4722-9a76-8878f27baff1', 'b1e0db10-85fa-40bc-b8fc-b31f2df6bd6a', '77b473b7-e4e8-48e2-8f69-60351ef28e0d', '2797a6dd-ea1a-481c-bcc9-bd163261245b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Delete snapshot completed successfully. Sep 25 16:07:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c999c649-e005-42cb-9589-a7eafb0097aa tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-9791afd5-9baf-4d92-a544-2dc9782fac57-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Creating offline snapshot 05fe4505-1b51-4062-b999-9e96702e6966 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef5e9e-0415-45ed-a389-75d63a413f96]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:33 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:33 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:34 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:34 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 1G Sep 25 16:07:34 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:34 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 1G" returned: 0 in 0.780s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:34 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 Sep 25 16:07:34 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:35 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966" returned: 0 in 0.541s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:35 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 is being set with open permissions: ugo+rw Sep 25 16:07:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:35 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 Sep 25 16:07:35 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:36 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-72328d71-cbef-40da-99a5-987b7d3e3878 tempest-SnapshotsActionsTest-1264032763 None] Create snapshot completed successfully Sep 25 16:07:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-05fe4505-1b51-4062-b999-9e96702e6966-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-05fe4505-1b51-4062-b999-9e96702e6966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Acquiring lock "cinder-quobyte-05fe4505-1b51-4062-b999-9e96702e6966" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-05fe4505-1b51-4062-b999-9e96702e6966" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Deleting offline snapshot 05fe4505-1b51-4062-b999-9e96702e6966 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] snapshot_file for this snap is: volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f2947-ddac-4a07-89b7-141f56b4ec0a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:37 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 Sep 25 16:07:37 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:37 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966" returned: 0 in 0.609s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977a721-9314-4fa7-9a53-19eaa8ab92e9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:38 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:38 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:38 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.801s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:38 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 Sep 25 16:07:38 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:39 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966" returned: 0 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:39 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966 Sep 25 16:07:39 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:40 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.05fe4505-1b51-4062-b999-9e96702e6966" returned: 0 in 0.577s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-05fe4505-1b51-4062-b999-9e96702e6966" released by "_delete_snapshot" :: held 3.119s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_snapshot" :: held 3.187s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:40 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Created reservations ['9314ec61-91f3-4a0a-8e4b-b06cd4d4835f', 'a215a6c0-dbfc-4088-b9a1-b9dd34614616', 'e2096a84-2288-4957-8a81-40516803887c', '0868d2c9-83b9-4091-bb91-ef4aa10c7b88'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Delete snapshot completed successfully. Sep 25 16:07:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-540c42a0-847c-4798-8569-bf7d7ce7e6d3 tempest-SnapshotsActionsTest-1685901949 None] Lock "cinder-05fe4505-1b51-4062-b999-9e96702e6966-delete_snapshot" released by "delete_snapshot" :: held 3.466s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "cinder-d850503e-7760-45e0-b3d0-ecffeb14a7c5-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-d850503e-7760-45e0-b3d0-ecffeb14a7c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "cinder-quobyte-d850503e-7760-45e0-b3d0-ecffeb14a7c5" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d850503e-7760-45e0-b3d0-ecffeb14a7c5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Deleting offline snapshot d850503e-7760-45e0-b3d0-ecffeb14a7c5 of volume d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] snapshot_file for this snap is: volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d5c73f-9985-4b0c-9f99-61fc27306dcd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:43 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:43 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:43 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1406b3-a319-454a-bd7e-9f3896f3da32]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:44 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad Sep 25 16:07:44 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:44 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad" returned: 0 in 0.898s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:44 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:44 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:45 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.719s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:45 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5 Sep 25 16:07:45 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:45 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad.d850503e-7760-45e0-b3d0-ecffeb14a7c5" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d850503e-7760-45e0-b3d0-ecffeb14a7c5" released by "_delete_snapshot" :: held 3.197s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_snapshot" :: held 3.228s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Created reservations ['96345bb1-46c6-4590-9e7a-f405c860bd33', '8e8281a0-f32c-4549-9c93-95e9f9e2fe27', '0e32e559-5c31-46dd-a658-8efbe3aca66f', '6652747b-37e3-4991-aa4d-6722f7da528f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Delete snapshot completed successfully. Sep 25 16:07:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8df74e4f-c795-4413-a23b-fb1782e9b112 tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-d850503e-7760-45e0-b3d0-ecffeb14a7c5-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "cinder-d7a0de18-a0f7-411b-ae75-0a70314e8bad-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-d7a0de18-a0f7-411b-ae75-0a70314e8bad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed425d35-e920-4ade-b27e-979747e92025]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:47 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad Sep 25 16:07:47 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:47 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad" returned: 0 in 0.503s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:48 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad Sep 25 16:07:48 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:48 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d7a0de18-a0f7-411b-ae75-0a70314e8bad" returned: 0 in 0.463s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-quobyte-d7a0de18-a0f7-411b-ae75-0a70314e8bad" released by "delete_volume" :: held 1.087s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Created reservations ['5f983661-74d6-424e-9514-134e2cbe4848', '1cc86e73-9367-4e7a-993a-122da2510f84', 'eec8792a-e57c-4067-b9f8-393aba8d812e', 'bfc81c9d-6fc7-4254-a638-2e8a7d1a8b52'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:48 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:07:48 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:49 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.611s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Deleted volume successfully. Sep 25 16:07:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cadb2fd4-3a5c-4b44-a16a-cbb7ff00ba5f tempest-SnapshotsActionsTest-1264032763 None] Lock "cinder-d7a0de18-a0f7-411b-ae75-0a70314e8bad-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:58 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=32,cinder:DELETE=4,cinder:SELECT=34,cinder:INSERT=12 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:59 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=47,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:06 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:08:06 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:06 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.550s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7d6857f4-0da2-4b46-a461-2537c5d32a06 req-fc9d9609-7548-4eda-bcf5-05cddfcc81cd tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7d6857f4-0da2-4b46-a461-2537c5d32a06 req-fc9d9609-7548-4eda-bcf5-05cddfcc81cd tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7d6857f4-0da2-4b46-a461-2537c5d32a06 req-fc9d9609-7548-4eda-bcf5-05cddfcc81cd tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-7d6857f4-0da2-4b46-a461-2537c5d32a06 req-fc9d9609-7548-4eda-bcf5-05cddfcc81cd tempest-ServerActionsTestOtherA-246211500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f56c6528-247d-4d6c-81da-8cb26a769815', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7d6857f4-0da2-4b46-a461-2537c5d32a06 req-fc9d9609-7548-4eda-bcf5-05cddfcc81cd tempest-ServerActionsTestOtherA-246211500 None] attachment_update completed successfully. Sep 25 16:08:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-45ce5140-6785-4fca-af88-5794acc7bd3f tempest-ServerActionsTestOtherA-246211500 None] Terminate volume connection completed successfully. Sep 25 16:08:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-45ce5140-6785-4fca-af88-5794acc7bd3f tempest-ServerActionsTestOtherA-246211500 None] Deleting attachment f56c6528-247d-4d6c-81da-8cb26a769815. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:08:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-a4e82096-1c35-4858-a073-c20cbedbd09a tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-a4e82096-1c35-4858-a073-c20cbedbd09a tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-a4e82096-1c35-4858-a073-c20cbedbd09a tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-a4e82096-1c35-4858-a073-c20cbedbd09a tempest-ServerActionsTestOtherA-246211500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed720386-4b1e-4741-84eb-88d235c3679a', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-33499a6b-3cc5-4c00-a7a6-215cdad08775 req-a4e82096-1c35-4858-a073-c20cbedbd09a tempest-ServerActionsTestOtherA-246211500 None] attachment_update completed successfully. Sep 25 16:08:27 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:27 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Flow 'volume_create_manager' (24e296d6-9a50-47e6-bfbf-e3b88723859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4af385-d88f-4f21-afc7-409bf933e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4af385-d88f-4f21-afc7-409bf933e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-476378349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b779bc-29b3-465f-ac6e-69b3a724e2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25ffeb7414d048a0143c49bbe03f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:28Z,use_quota=True,user_id='409621fc77d846bb9767d459156dd3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ad08ba-49b1-4ec4-9a99-3cd9c8418336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ad08ba-49b1-4ec4-9a99-3cd9c8418336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dd1ce6-9022-41c1-9576-433ae0d121e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dd1ce6-9022-41c1-9576-433ae0d121e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b779bc-29b3-465f-ac6e-69b3a724e2fe', 'volume_name': 'volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f7208-0b3a-4e9b-9f5c-d15606eb2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f7208-0b3a-4e9b-9f5c-d15606eb2e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f969114-e1d5-4c0c-b5a4-3777b84e26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Volume 91b779bc-29b3-465f-ac6e-69b3a724e2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe', 'volume_size': 1} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-476378349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b779bc-29b3-465f-ac6e-69b3a724e2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25ffeb7414d048a0143c49bbe03f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:28Z,use_quota=True,user_id='409621fc77d846bb9767d459156dd3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Creating volume 91b779bc-29b3-465f-ac6e-69b3a724e2fe {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:08:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:28 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe 1073741824 Sep 25 16:08:28 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:29 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe 1073741824" returned: 0 in 0.962s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:29 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe Sep 25 16:08:29 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:29 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe" returned: 0 in 0.576s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f969114-e1d5-4c0c-b5a4-3777b84e26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674c714c-1392-4051-ad4a-29eb6254d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Volume volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe (91b779bc-29b3-465f-ac6e-69b3a724e2fe): created successfully Sep 25 16:08:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674c714c-1392-4051-ad4a-29eb6254d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Flow 'volume_create_manager' (24e296d6-9a50-47e6-bfbf-e3b88723859f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-16c3945a-9c8f-4a3a-9629-77c916b2a53b tempest-ServersNegativeTestJSON-780037790 None] Created volume successfully. Sep 25 16:08:33 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Flow 'volume_create_manager' (8a5a3c5c-54c1-457c-a9fa-c1aaeae8edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cb5e4a-71c7-4d1e-83d6-850b6dbfe793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cb5e4a-71c7-4d1e-83d6-850b6dbfe793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-51013440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab1d5b6-7657-4942-8555-9ea99a673abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25ffeb7414d048a0143c49bbe03f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:34Z,use_quota=True,user_id='409621fc77d846bb9767d459156dd3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9c1e35-8d01-4c7d-a9bb-2bf770824914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9c1e35-8d01-4c7d-a9bb-2bf770824914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b61a2-7166-4e8e-a448-c18bc3161f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b61a2-7166-4e8e-a448-c18bc3161f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab1d5b6-7657-4942-8555-9ea99a673abb', 'volume_name': 'volume-eab1d5b6-7657-4942-8555-9ea99a673abb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff947f4-8ea9-4eb6-9f3f-405ef352a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff947f4-8ea9-4eb6-9f3f-405ef352a819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2d689-058d-4436-b8e8-4ed0d1a3c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Volume eab1d5b6-7657-4942-8555-9ea99a673abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab1d5b6-7657-4942-8555-9ea99a673abb', 'volume_size': 1} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-51013440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab1d5b6-7657-4942-8555-9ea99a673abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25ffeb7414d048a0143c49bbe03f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:34Z,use_quota=True,user_id='409621fc77d846bb9767d459156dd3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Creating volume eab1d5b6-7657-4942-8555-9ea99a673abb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:34 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:08:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:34 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb 1073741824 Sep 25 16:08:34 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:35 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb 1073741824" returned: 0 in 1.025s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb Sep 25 16:08:35 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:35 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2d689-058d-4436-b8e8-4ed0d1a3c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab1d5b6-7657-4942-8555-9ea99a673abb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac8b78e-4ca8-4ebb-b504-edadc4f25e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Volume volume-eab1d5b6-7657-4942-8555-9ea99a673abb (eab1d5b6-7657-4942-8555-9ea99a673abb): created successfully Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac8b78e-4ca8-4ebb-b504-edadc4f25e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Flow 'volume_create_manager' (8a5a3c5c-54c1-457c-a9fa-c1aaeae8edef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ade4e366-1adc-41a9-b746-c98243e636a3 tempest-ServersNegativeTestJSON-780037790 None] Created volume successfully. Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "cinder-eab1d5b6-7657-4942-8555-9ea99a673abb-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-eab1d5b6-7657-4942-8555-9ea99a673abb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "cinder-quobyte-eab1d5b6-7657-4942-8555-9ea99a673abb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-quobyte-eab1d5b6-7657-4942-8555-9ea99a673abb" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231f009-0c1a-4b0d-8cc2-751482a70fc8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:38 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb Sep 25 16:08:38 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:38 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb" returned: 0 in 0.525s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb Sep 25 16:08:39 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:39 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab1d5b6-7657-4942-8555-9ea99a673abb" returned: 0 in 0.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-quobyte-eab1d5b6-7657-4942-8555-9ea99a673abb" released by "delete_volume" :: held 1.122s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Created reservations ['e25ab629-da6f-48f8-ae3a-ab650512534d', '638e1ae7-627c-49db-8bb6-b51ced0156e6', 'c00592a3-abfc-4365-a2be-2ee1f85516ed', '49f588f9-d4d2-429d-88d1-1e9646aaae17'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:08:39 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:40 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Deleted volume successfully. Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e25d8b2f-d4a4-4add-a47c-c856870ca273 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-eab1d5b6-7657-4942-8555-9ea99a673abb-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "cinder-91b779bc-29b3-465f-ac6e-69b3a724e2fe-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-91b779bc-29b3-465f-ac6e-69b3a724e2fe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "cinder-quobyte-91b779bc-29b3-465f-ac6e-69b3a724e2fe" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-quobyte-91b779bc-29b3-465f-ac6e-69b3a724e2fe" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00a606-0eee-4129-9ee2-f773e80d9048]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:41 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe Sep 25 16:08:41 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:41 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe" returned: 0 in 0.659s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:41 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe Sep 25 16:08:41 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:42 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-91b779bc-29b3-465f-ac6e-69b3a724e2fe" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-quobyte-91b779bc-29b3-465f-ac6e-69b3a724e2fe" released by "delete_volume" :: held 1.223s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Created reservations ['f7a2ff1e-f0e2-4f5f-a7f8-023b2d5b8dad', 'c5920ff2-146c-4da6-8175-ac2512162732', 'd739c4e2-9b9c-4d1f-ae08-b8be33ac8ed5', 'f5f92988-c841-4367-bbe3-2967705b36cb'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:42 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:08:42 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:42 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Deleted volume successfully. Sep 25 16:08:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38838f64-e072-40da-87e1-96383af0dc08 tempest-ServersNegativeTestJSON-780037790 None] Lock "cinder-91b779bc-29b3-465f-ac6e-69b3a724e2fe-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Flow 'volume_create_manager' (45030ca5-a474-4754-a187-19f110e540ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af798f3c-31a3-4bef-b2c2-a1d73b9f32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af798f3c-31a3-4bef-b2c2-a1d73b9f32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2013075281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e14cd3-7f98-4299-89e7-43d95b7b8ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6cbd6ca6a44df86d58fe884d9ce4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:48Z,use_quota=True,user_id='1cf9ed719c3e407dafc41052ef535676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bd4d4b-65f9-4ec3-91fe-c78f1acba511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bd4d4b-65f9-4ec3-91fe-c78f1acba511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3b3bd-ff96-4d55-a960-d8bd86073d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3b3bd-ff96-4d55-a960-d8bd86073d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e14cd3-7f98-4299-89e7-43d95b7b8ea0', 'volume_name': 'volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95591c-97f4-42e5-8e44-b6139a56a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95591c-97f4-42e5-8e44-b6139a56a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0e0de6-88b2-4afd-a93e-c01ddd15d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Volume b8e14cd3-7f98-4299-89e7-43d95b7b8ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0', 'volume_size': 1} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2013075281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e14cd3-7f98-4299-89e7-43d95b7b8ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6cbd6ca6a44df86d58fe884d9ce4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:48Z,use_quota=True,user_id='1cf9ed719c3e407dafc41052ef535676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Creating volume b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:47 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:08:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:47 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 1073741824 Sep 25 16:08:47 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:48 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 1073741824" returned: 0 in 0.621s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:48 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 Sep 25 16:08:48 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:48 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" returned: 0 in 0.337s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0e0de6-88b2-4afd-a93e-c01ddd15d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080f293-9b1d-4443-8b4d-e84f1677420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Volume volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 (b8e14cd3-7f98-4299-89e7-43d95b7b8ea0): created successfully Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080f293-9b1d-4443-8b4d-e84f1677420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Flow 'volume_create_manager' (45030ca5-a474-4754-a187-19f110e540ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-25686916-02a8-4e12-9517-5daccef741f6 tempest-AbsoluteLimitsTests-1616508152 None] Created volume successfully. Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Acquiring lock "cinder-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "cinder-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Acquiring lock "cinder-quobyte-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "cinder-quobyte-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e60083-1b5b-48ce-b195-e71c74089d9a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:50 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 Sep 25 16:08:50 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:50 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" returned: 0 in 0.581s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:50 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0 Sep 25 16:08:50 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:51 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "cinder-quobyte-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0" released by "delete_volume" :: held 1.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Created reservations ['b56bd35c-c912-4dbf-a565-38a10c60b0d2', '820b59d5-d869-4737-a8cc-d5e117abb5ff', 'bb1d0a40-586e-4144-aa01-6a101ef9dbb2', 'd2b4daac-f2d6-4847-ac28-fd0853661ea6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:51 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:08:51 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:51 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.310s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Deleted volume successfully. Sep 25 16:08:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0026f8c0-1b05-41df-92ed-f442d6f0230f tempest-AbsoluteLimitsTests-1616508152 None] Lock "cinder-b8e14cd3-7f98-4299-89e7-43d95b7b8ea0-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0bc52c23-7dc9-41c9-95a9-d880097685ef req-7d10137a-11b8-4a08-a23d-c425a9e5005f tempest-ServerActionsTestOtherA-246211500 None] Terminate volume connection completed successfully. Sep 25 16:08:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0bc52c23-7dc9-41c9-95a9-d880097685ef req-7d10137a-11b8-4a08-a23d-c425a9e5005f tempest-ServerActionsTestOtherA-246211500 None] Deleting attachment ed720386-4b1e-4741-84eb-88d235c3679a. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:08:59 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Flow 'volume_create_manager' (c4c92e27-459c-4e45-bdfc-44115d600c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f968aef-9f42-454e-8e99-c325a65c30ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f968aef-9f42-454e-8e99-c325a65c30ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2018976451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0a75b5-da2c-436b-b9c2-da6baf3df41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c24b1915924bbfadee0397e78da9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:00Z,use_quota=True,user_id='052c0bd4e6074df1b0c1c5d1307a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8666e424-960d-4989-940c-1fc7596b6e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8666e424-960d-4989-940c-1fc7596b6e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6c0992-117c-448e-bf4b-57c930729983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6c0992-117c-448e-bf4b-57c930729983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0a75b5-da2c-436b-b9c2-da6baf3df41c', 'volume_name': 'volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc58b29-8b38-4306-b773-ed45b5110571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc58b29-8b38-4306-b773-ed45b5110571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2c18db-9e33-42ae-a6f1-5024ab3ed343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Volume da0a75b5-da2c-436b-b9c2-da6baf3df41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c', 'volume_size': 1} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2018976451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0a75b5-da2c-436b-b9c2-da6baf3df41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c24b1915924bbfadee0397e78da9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:00Z,use_quota=True,user_id='052c0bd4e6074df1b0c1c5d1307a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Creating volume da0a75b5-da2c-436b-b9c2-da6baf3df41c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:00 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:00 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c 1073741824 Sep 25 16:09:00 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:00 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c 1073741824" returned: 0 in 0.829s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:01 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c Sep 25 16:09:01 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:01 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2c18db-9e33-42ae-a6f1-5024ab3ed343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a317ca6-4803-4d61-9d4a-92236c6c0aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Volume volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c (da0a75b5-da2c-436b-b9c2-da6baf3df41c): created successfully Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a317ca6-4803-4d61-9d4a-92236c6c0aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Flow 'volume_create_manager' (c4c92e27-459c-4e45-bdfc-44115d600c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e0aef670-b425-4402-b726-c2ce873ca3a8 tempest-AttachVolumeShelveTestJSON-30055082 None] Created volume successfully. Sep 25 16:09:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c3b51a17-d3df-4525-a0c5-21375b741cbb tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1047109815: creating Sep 25 16:09:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c3b51a17-d3df-4525-a0c5-21375b741cbb tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1047109815: created successfully Sep 25 16:09:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c3b51a17-d3df-4525-a0c5-21375b741cbb tempest-GroupSnapshotsTest-765992417 None] Create group completed successfully. Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Flow 'volume_create_manager' (1c3c30b4-d3f0-497a-8715-5c81624f4d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8343e0df-d27c-4c55-a79b-001f216314b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8343e0df-d27c-4c55-a79b-001f216314b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-778607225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9586c77c-1262-4400-b937-3b2f2a7c7c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14a94666fa9411eacff1162aa013060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:03Z,use_quota=True,user_id='6f63567e08e8405fb21d6364c30be270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8623363a-12da-4c17-91ab-0ae20ad78e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8623363a-12da-4c17-91ab-0ae20ad78e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6144e78e-e54f-4bad-b1fe-b7e3922ab070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:03 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6144e78e-e54f-4bad-b1fe-b7e3922ab070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9586c77c-1262-4400-b937-3b2f2a7c7c42', 'volume_name': 'volume-9586c77c-1262-4400-b937-3b2f2a7c7c42', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c8a7d5-a7ad-4f46-88f9-65fd9d6a254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c8a7d5-a7ad-4f46-88f9-65fd9d6a254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687791d4-dbc3-49e9-a5c3-da8d14d19ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Volume 9586c77c-1262-4400-b937-3b2f2a7c7c42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9586c77c-1262-4400-b937-3b2f2a7c7c42', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Trying to clone 9586c77c-1262-4400-b937-3b2f2a7c7c42 from image a5d467e0-719a-49cf-b176-4393aa2e5a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (7843426e-6fcc-4615-95fb-ef0ab21bda03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67daca4-5e18-4ba4-ba72-0cf4558d12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67daca4-5e18-4ba4-ba72-0cf4558d12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878917349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7385803-03e6-4ecb-88ed-ee78c390ea15,host='devstack@QuobyteHD#QuobyteHD',id=f3e5befa-83a7-47dd-be32-c6eb92a08aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:04Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(377a86aa-93e6-40fc-a500-eb1634979924),volume_type_id=377a86aa-93e6-40fc-a500-eb1634979924)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bfaace-05ff-415c-857d-3ced52476d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bfaace-05ff-415c-857d-3ced52476d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c562dbc0-b9a6-4b91-9cf8-630ad8c054c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c562dbc0-b9a6-4b91-9cf8-630ad8c054c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e5befa-83a7-47dd-be32-c6eb92a08aa3', 'volume_name': 'volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd520ba-4b2d-4e8e-9fa4-e80df95f5a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd520ba-4b2d-4e8e-9fa4-e80df95f5a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8855aca-0662-4061-84b1-0f188f460eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Volume f3e5befa-83a7-47dd-be32-c6eb92a08aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3', 'volume_size': 1} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7385803-03e6-4ecb-88ed-ee78c390ea15,created_at=2026-09-25T14:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878917349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7385803-03e6-4ecb-88ed-ee78c390ea15,host='devstack@QuobyteHD#QuobyteHD',id=f3e5befa-83a7-47dd-be32-c6eb92a08aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:04Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(377a86aa-93e6-40fc-a500-eb1634979924),volume_type_id=377a86aa-93e6-40fc-a500-eb1634979924)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Creating volume f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:04 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 1073741824 Sep 25 16:09:04 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:09:05 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[65741304-861f-49a1-a1a8-d0748aed409b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:05 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD Sep 25 16:09:05 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:05 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Flow 'volume_create_manager' (4ba8df66-4c44-4c2e-9193-6631fcd87cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e392cd2-48eb-4ed4-8946-8597514b1a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 1073741824" returned: 0 in 0.941s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e392cd2-48eb-4ed4-8946-8597514b1a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1805918713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc9f7e1-78f5-4e51-a8df-56e2549c65d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e59c009444337900f0c41174de77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:06Z,use_quota=True,user_id='2a3264e4aecf47e18d4360dbf029566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a801b5-38f1-46cc-a635-f43b7dbe2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a801b5-38f1-46cc-a635-f43b7dbe2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f017a5-fa68-43eb-bc13-9cf57abb714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f017a5-fa68-43eb-bc13-9cf57abb714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc9f7e1-78f5-4e51-a8df-56e2549c65d4', 'volume_name': 'volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413e7b52-8dc9-46e5-ae8c-f05f3f0feeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413e7b52-8dc9-46e5-ae8c-f05f3f0feeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93deee7-11d1-4b89-82b8-351c6abe4cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Volume 5dc9f7e1-78f5-4e51-a8df-56e2549c65d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4', 'volume_size': 1} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:05 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:05 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:05 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:05 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d is fetched for user 6f63567e08e8405fb21d6364c30be270. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bfca59-6a10-468d-a566-572283b6b70f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:06 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:06 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:06 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 0.390s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1805918713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc9f7e1-78f5-4e51-a8df-56e2549c65d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e59c009444337900f0c41174de77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:06Z,use_quota=True,user_id='2a3264e4aecf47e18d4360dbf029566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Creating volume 5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8855aca-0662-4061-84b1-0f188f460eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:06 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 1073741824 Sep 25 16:09:06 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d151e67-5345-4bd5-b2ff-4bb556e46054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:06 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD Sep 25 16:09:06 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Volume volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 (f3e5befa-83a7-47dd-be32-c6eb92a08aa3): created successfully Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d151e67-5345-4bd5-b2ff-4bb556e46054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (7843426e-6fcc-4615-95fb-ef0ab21bda03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1c442e93-4dc2-4b02-b427-2ea868133527 tempest-GroupSnapshotsTest-765992417 None] Created volume successfully. Sep 25 16:09:06 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.486s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:09:06 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:06 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 1073741824" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:07 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 Sep 25 16:09:07 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:07 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-778607225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9586c77c-1262-4400-b937-3b2f2a7c7c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14a94666fa9411eacff1162aa013060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:03Z,use_quota=True,user_id='6f63567e08e8405fb21d6364c30be270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Creating volume 9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:07 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93deee7-11d1-4b89-82b8-351c6abe4cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44bab35-052a-4b35-9c95-2dc34bed3b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:07 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1073741824 Sep 25 16:09:07 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Volume volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 (5dc9f7e1-78f5-4e51-a8df-56e2549c65d4): created successfully Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44bab35-052a-4b35-9c95-2dc34bed3b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Flow 'volume_create_manager' (4ba8df66-4c44-4c2e-9193-6631fcd87cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4139d651-10be-48c2-af95-1b339ba68000 tempest-VolumesTransfersV355Test-539307392 None] Created volume successfully. Sep 25 16:09:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] GroupSnapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: creating. Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Group snapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:09:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:08 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1073741824" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 Sep 25 16:09:08 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:08 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42" returned: 0 in 0.289s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.811s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Creating offline snapshot 38676486-1116-48a9-b02a-53cdaa5df418 of volume f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[42547713-7c7f-4c52-8031-385591698a99]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Attempting download of a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume 9586c77c-1262-4400-b937-3b2f2a7c7c42. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82ba3c-e862-4669-824f-4e4af0648a5f]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_ {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:08 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:08 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_ Sep 25 16:09:08 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ca7e544c-dd97-4b33-87e5-0f7397d60543 tempest-VolumesTransfersV355Test-561740525 None] Transfer volume completed successfully. Sep 25 16:09:08 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 1G Sep 25 16:09:08 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_" returned: 0 in 0.521s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_ {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:09 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_ Sep 25 16:09:09 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_" returned: 1 in 0.526s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_epa2y6i_' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[19433d6a-d2c9-46ac-8fdb-ff4a40ff6c4a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:09 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 1G" returned: 0 in 0.698s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:09 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:09 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "cinder-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:09 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD Sep 25 16:09:09 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "cinder-quobyte-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-quobyte-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[60710ebc-e580-4477-8d3e-56785390d983]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 Sep 25 16:09:10 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] a5d467e0-719a-49cf-b176-4393aa2e5a8d was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 Sep 25 16:09:10 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:10 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" returned: 0 in 0.517s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4 Sep 25 16:09:10 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.436s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info Sep 25 16:09:10 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-quobyte-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4" released by "delete_volume" :: held 1.091s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Created reservations ['f3e160b2-8083-455d-a7c5-43f31a5de56a', 'a226146f-30ec-4ff3-934f-090835c97634', 'ce2a878f-2da5-41a0-ab8b-c521c9f3a5d8', 'f559f929-9418-4771-8420-23c139b80681'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:11 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:11 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:11 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:11 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:11 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info Sep 25 16:09:11 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:11 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.315s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Deleted volume successfully. Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b787a278-b2b9-4b11-8b30-0162fe4dc174 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-5dc9f7e1-78f5-4e51-a8df-56e2549c65d4-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:11 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.info" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4427850f-52ad-48be-9b08-0a97a3683393 tempest-GroupSnapshotsTest-765992417 None] group_snapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: created successfully Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Flow 'volume_create_manager' (4b412a13-8af0-4b06-8cd2-520aa685d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb79ad6-32c6-4b00-89c3-eba13cd8ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb79ad6-32c6-4b00-89c3-eba13cd8ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2083374447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40898871-8e20-4f6b-803a-fa05f8090ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e59c009444337900f0c41174de77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:13Z,use_quota=True,user_id='2a3264e4aecf47e18d4360dbf029566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c947ca-0b64-4740-9b77-cbc27300cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c947ca-0b64-4740-9b77-cbc27300cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83747288-ef39-4588-8026-99c81dbfb40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83747288-ef39-4588-8026-99c81dbfb40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40898871-8e20-4f6b-803a-fa05f8090ad2', 'volume_name': 'volume-40898871-8e20-4f6b-803a-fa05f8090ad2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a33e1-1803-4e48-b3cb-227f1f9c2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4a33e1-1803-4e48-b3cb-227f1f9c2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62cfb20-d605-4bc4-a0b9-9b86e70c8258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Volume 40898871-8e20-4f6b-803a-fa05f8090ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40898871-8e20-4f6b-803a-fa05f8090ad2', 'volume_size': 1} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2083374447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40898871-8e20-4f6b-803a-fa05f8090ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e59c009444337900f0c41174de77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:13Z,use_quota=True,user_id='2a3264e4aecf47e18d4360dbf029566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Creating volume 40898871-8e20-4f6b-803a-fa05f8090ad2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:12 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:12 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 1073741824 Sep 25 16:09:12 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:13 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42" returned: 0 in 3.154s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_slxnsa_sdevstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:09:13 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Converted 112.00 MB image at 35.46 MB/s Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:13 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1G Sep 25 16:09:13 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:13 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 1G" returned: 0 in 0.563s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Downloaded image a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume 9586c77c-1262-4400-b937-3b2f2a7c7c42 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d for user 6f63567e08e8405fb21d6364c30be270 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Marking volume 9586c77c-1262-4400-b937-3b2f2a7c7c42 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Copying metadata from image a5d467e0-719a-49cf-b176-4393aa2e5a8d to 9586c77c-1262-4400-b937-3b2f2a7c7c42. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Creating volume glance metadata for volume 9586c77c-1262-4400-b937-3b2f2a7c7c42 backed by image a5d467e0-719a-49cf-b176-4393aa2e5a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:09:13 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 1073741824" returned: 0 in 0.978s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:13 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 Sep 25 16:09:13 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687791d4-dbc3-49e9-a5c3-da8d14d19ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9586c77c-1262-4400-b937-3b2f2a7c7c42', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d607fb7f-dd41-4377-a413-3735df877322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Volume volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 (9586c77c-1262-4400-b937-3b2f2a7c7c42): created successfully Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d607fb7f-dd41-4377-a413-3735df877322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Flow 'volume_create_manager' (1c3c30b4-d3f0-497a-8715-5c81624f4d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-490ff57b-528e-4c00-a612-f749d2e9594c tempest-ServerActionsTestOtherA-246211500 None] Created volume successfully. Sep 25 16:09:14 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.792s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418-f65672ed-837a-47de-943b-47888dcceab6" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62cfb20-d605-4bc4-a0b9-9b86e70c8258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40898871-8e20-4f6b-803a-fa05f8090ad2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3d8e12-7837-4ebd-874d-8070192612e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418-f65672ed-837a-47de-943b-47888dcceab6" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Creating volume f65672ed-837a-47de-943b-47888dcceab6 from snapshot 38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Volume volume-40898871-8e20-4f6b-803a-fa05f8090ad2 (40898871-8e20-4f6b-803a-fa05f8090ad2): created successfully Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3d8e12-7837-4ebd-874d-8070192612e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Flow 'volume_create_manager' (4b412a13-8af0-4b06-8cd2-520aa685d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] snapshot: 38676486-1116-48a9-b02a-53cdaa5df418, volume: f65672ed-837a-47de-943b-47888dcceab6, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:09:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e6010c0f-a894-4b68-bc9b-d41aece3cbff tempest-VolumesTransfersV355Test-539307392 None] Created volume successfully. Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8f2528-a7b2-407b-b6a6-f33952dccb57]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:14 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:14 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.574s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271c76c-f546-415c-9a57-090ac8e2fe10]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:15 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "cinder-40898871-8e20-4f6b-803a-fa05f8090ad2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-40898871-8e20-4f6b-803a-fa05f8090ad2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "cinder-quobyte-40898871-8e20-4f6b-803a-fa05f8090ad2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-quobyte-40898871-8e20-4f6b-803a-fa05f8090ad2" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54c903-bfba-4001-922a-2ce43c54e590]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 0.633s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:09:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 Sep 25 16:09:15 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 Sep 25 16:09:15 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2" returned: 0 in 0.584s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-034a5f05-1dc4-4dbc-97fc-e9304b67421b req-8fb04323-0361-4b6b-9025-78684ca63d60 tempest-AttachVolumeShelveTestJSON-30055082 None] No connector for attachment fcf20cdd-e45c-40ae-9209-95a59f328a8d; skipping storage backend terminate_connection call. {{(pid=87199) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-034a5f05-1dc4-4dbc-97fc-e9304b67421b req-8fb04323-0361-4b6b-9025-78684ca63d60 tempest-AttachVolumeShelveTestJSON-30055082 None] Deleting attachment fcf20cdd-e45c-40ae-9209-95a59f328a8d. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:09:16 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2 Sep 25 16:09:16 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-40898871-8e20-4f6b-803a-fa05f8090ad2" returned: 0 in 0.546s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-quobyte-40898871-8e20-4f6b-803a-fa05f8090ad2" released by "delete_volume" :: held 1.211s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Created reservations ['1e7caa7d-fd02-483c-b836-231f18828f00', 'd4482d2d-218d-4211-96d9-902bcad3d550', 'd51ddb38-a345-4376-b76b-b98a5273e852', 'a891beb6-f318-4cfb-af16-66bc7e922d41'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:17 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:17 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:18 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Deleted volume successfully. Sep 25 16:09:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9bcca932-c8a5-494b-90c2-283e264bb255 tempest-VolumesTransfersV355Test-113097312 None] Lock "cinder-40898871-8e20-4f6b-803a-fa05f8090ad2-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5212bc6f-5a84-4b9d-9d29-bacd1ba85b0c req-6dd1c761-ee24-45e8-8978-bbcc14178292 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:27 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6" returned: 0 in 11.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3, size 1024.00 MB, duration 11.57 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:09:27 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Converted 1024.00 MB image at 88.49 MB/s Sep 25 16:09:27 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:27 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 Sep 25 16:09:27 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:27 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6" returned: 0 in 0.401s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" released by "_copy_volume_from_snapshot" :: held 13.351s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=69,cinder:SELECT=63,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418-f65672ed-837a-47de-943b-47888dcceab6" released by "_create_volume_from_snapshot" :: held 13.494s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.538s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5212bc6f-5a84-4b9d-9d29-bacd1ba85b0c req-6dd1c761-ee24-45e8-8978-bbcc14178292 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.333s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5212bc6f-5a84-4b9d-9d29-bacd1ba85b0c req-6dd1c761-ee24-45e8-8978-bbcc14178292 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5212bc6f-5a84-4b9d-9d29-bacd1ba85b0c req-6dd1c761-ee24-45e8-8978-bbcc14178292 tempest-ServerActionsTestOtherA-246211500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-9586c77c-1262-4400-b937-3b2f2a7c7c42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d7d198b-9992-4f61-8a42-51b90fca79b4', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:09:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4f336af7-b8a1-48d8-9a96-a1f7ff6c1c05 tempest-GroupSnapshotsTest-765992417 None] Create group from source-snapshot-a6ca0c5a-4830-49f2-a54d-6f0f5f36f321 completed successfully. Sep 25 16:09:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5212bc6f-5a84-4b9d-9d29-bacd1ba85b0c req-6dd1c761-ee24-45e8-8978-bbcc14178292 tempest-ServerActionsTestOtherA-246211500 None] attachment_update completed successfully. Sep 25 16:09:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a4b63c-a4bc-4770-a509-2abd59fd4ff0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:30 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 Sep 25 16:09:30 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:31 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6" returned: 0 in 0.747s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:31 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6 Sep 25 16:09:31 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:31 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f65672ed-837a-47de-943b-47888dcceab6" returned: 0 in 0.745s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f65672ed-837a-47de-943b-47888dcceab6" released by "delete_volume" :: held 1.609s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['bc3dd07c-dd2a-4216-a827-443ede8860fc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:32 devstack cinder-volume[87199]: WARNING cinder.quota [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-402263368 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-402263368, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:09:32 devstack cinder-volume[87199]: WARNING cinder.quota [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-402263368 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-402263368, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['a35ab712-c05a-4b3a-854e-4c3b3e7cf0a9', '65e04614-8d5a-4e7e-b1b1-4e37c04d90df', '88a499ce-2a33-4978-a644-86a5d50a81c5', 'b6251e86-5b88-4d3a-b94a-4b9e1dfafcb6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:32 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:32 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:33 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.598s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aaa5adc1-9900-4275-abf0-59d097b1f825 tempest-GroupSnapshotsTest-765992417 None] Delete group completed successfully. Sep 25 16:09:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] group_snapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: deleting Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] group_snapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Deleting offline snapshot 38676486-1116-48a9-b02a-53cdaa5df418 of volume f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] snapshot_file for this snap is: volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4729a84a-fe7b-4397-929c-0a4c7287bb91]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:34 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:34 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:34 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.719s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[78beb9ae-ba31-4f1e-8c18-25cad9b3687e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:35 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:35 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:36 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 1.567s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:36 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:36 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.734s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:37 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418 Sep 25 16:09:37 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3.38676486-1116-48a9-b02a-53cdaa5df418" returned: 0 in 0.689s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-38676486-1116-48a9-b02a-53cdaa5df418" released by "_delete_snapshot" :: held 4.013s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" released by "delete_snapshot" :: held 4.066s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:38 devstack cinder-volume[87199]: WARNING cinder.quota [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-402263368 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-402263368, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:09:38 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['9e7c4f7f-b97b-4b31-87b5-49d65e7acb36', '66c5716c-4fbe-4ab6-954b-78f7113ba426', 'd1881612-ad9b-48af-9e2a-fc6a11154822', '41c3019e-d818-4e8c-ae25-60e1cbf7a696'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac4f984f-2957-4651-947e-ec12575dbd84 tempest-GroupSnapshotsTest-765992417 None] group_snapshot a6ca0c5a-4830-49f2-a54d-6f0f5f36f321: deleted successfully Sep 25 16:09:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" acquired by "delete_volume" :: waited 0.045s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d30b66-ff05-4c40-a9b6-b1a29d9c7ace]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:39 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:39 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:40 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 1.246s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:40 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3 Sep 25 16:09:40 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:41 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" returned: 0 in 1.199s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-f3e5befa-83a7-47dd-be32-c6eb92a08aa3" released by "delete_volume" :: held 2.640s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['f346f234-f218-437f-9db9-d5739dac258a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:42 devstack cinder-volume[87199]: WARNING cinder.db.api [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-402263368'] Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['df415ed8-87cf-4657-81ed-e0cbbe3bf7d2', '03c5f42f-efe5-4fe9-89fb-853c43889e5f', '6ff20eaf-b948-4fa4-a8c3-f2ea9e39ac33', '9fddfd79-8d11-49ff-be7e-b4e63dbcbbb6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:42 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:42 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Flow 'volume_create_manager' (d9c442f9-e96a-4cec-a4d4-3fbea8d2c54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f21ab55-3216-4544-bec6-2b48fa27eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f21ab55-3216-4544-bec6-2b48fa27eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2009860017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bec344-e114-4f03-ab43-0c620aa45ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5246b2c99444d80919b3d48cb26cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:43Z,use_quota=True,user_id='f679e337b1f64c57ae9fbe1109e2e573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e20d67-bf53-47f3-88ed-6348214d7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e20d67-bf53-47f3-88ed-6348214d7a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aac1d0f-1d18-49a1-8036-3224415a4c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aac1d0f-1d18-49a1-8036-3224415a4c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bec344-e114-4f03-ab43-0c620aa45ae7', 'volume_name': 'volume-82bec344-e114-4f03-ab43-0c620aa45ae7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0f22e2-bace-4137-9445-f2a88ecd43b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0f22e2-bace-4137-9445-f2a88ecd43b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72d55a-8b46-43d9-859a-fe64463e2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Volume 82bec344-e114-4f03-ab43-0c620aa45ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bec344-e114-4f03-ab43-0c620aa45ae7', 'volume_size': 1} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2009860017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bec344-e114-4f03-ab43-0c620aa45ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5246b2c99444d80919b3d48cb26cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:43Z,use_quota=True,user_id='f679e337b1f64c57ae9fbe1109e2e573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Creating volume 82bec344-e114-4f03-ab43-0c620aa45ae7 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.731s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-28ba53ec-9308-4edc-8707-e0409b1df8d8 tempest-GroupSnapshotsTest-765992417 None] Delete group completed successfully. Sep 25 16:09:43 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 1073741824 Sep 25 16:09:43 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dc9ab722-eb70-4abe-96b9-42424ced3282 tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1828287136: creating Sep 25 16:09:44 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 1073741824" returned: 0 in 1.421s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dc9ab722-eb70-4abe-96b9-42424ced3282 tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1828287136: created successfully Sep 25 16:09:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dc9ab722-eb70-4abe-96b9-42424ced3282 tempest-GroupSnapshotsTest-765992417 None] Create group completed successfully. Sep 25 16:09:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:44 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 Sep 25 16:09:44 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:45 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72d55a-8b46-43d9-859a-fe64463e2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bec344-e114-4f03-ab43-0c620aa45ae7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ae51f3-ec9f-447a-ba94-e43b515635a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Volume volume-82bec344-e114-4f03-ab43-0c620aa45ae7 (82bec344-e114-4f03-ab43-0c620aa45ae7): created successfully Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ae51f3-ec9f-447a-ba94-e43b515635a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Flow 'volume_create_manager' (d9c442f9-e96a-4cec-a4d4-3fbea8d2c54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dc8d1f60-2497-4326-8ba6-0ca0bdad5763 tempest-VolumesTransfersV357Test-1350988939 None] Created volume successfully. Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (ea7675f6-a825-43f3-97bd-b282983448b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25286e3-d52b-47d4-bba1-fde6f715c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25286e3-d52b-47d4-bba1-fde6f715c690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1604866359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,host='devstack@QuobyteHD#QuobyteHD',id=e729842c-343f-43af-b24f-88a5eb1ca7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:48Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b77a3396-cc0b-4cd4-b04d-9ba4476170c0),volume_type_id=b77a3396-cc0b-4cd4-b04d-9ba4476170c0)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8a4d0-dd12-4266-91f3-cbdaf50f629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8a4d0-dd12-4266-91f3-cbdaf50f629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9589dc-a4df-41ef-9d20-df4622b7e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9589dc-a4df-41ef-9d20-df4622b7e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e729842c-343f-43af-b24f-88a5eb1ca7dd', 'volume_name': 'volume-e729842c-343f-43af-b24f-88a5eb1ca7dd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24ff94-3aac-40a1-85b0-58b942c07d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24ff94-3aac-40a1-85b0-58b942c07d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6595fda4-1edc-4036-8369-8676f5527342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Volume e729842c-343f-43af-b24f-88a5eb1ca7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e729842c-343f-43af-b24f-88a5eb1ca7dd', 'volume_size': 1} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,created_at=2026-09-25T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1604866359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,host='devstack@QuobyteHD#QuobyteHD',id=e729842c-343f-43af-b24f-88a5eb1ca7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:48Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b77a3396-cc0b-4cd4-b04d-9ba4476170c0),volume_type_id=b77a3396-cc0b-4cd4-b04d-9ba4476170c0)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Creating volume e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:48 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:48 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd 1073741824 Sep 25 16:09:48 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6b843efa-45a1-484e-86f6-d8bdd09644ef tempest-VolumesTransfersV357Test-225288232 None] Transfer volume completed successfully. Sep 25 16:09:49 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd 1073741824" returned: 0 in 1.228s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:49 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd Sep 25 16:09:49 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:50 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd" returned: 0 in 0.790s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6595fda4-1edc-4036-8369-8676f5527342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e729842c-343f-43af-b24f-88a5eb1ca7dd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33755b85-1e30-476f-b320-c4c05a318099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Volume volume-e729842c-343f-43af-b24f-88a5eb1ca7dd (e729842c-343f-43af-b24f-88a5eb1ca7dd): created successfully Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33755b85-1e30-476f-b320-c4c05a318099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (ea7675f6-a825-43f3-97bd-b282983448b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-40efd117-eab4-4dde-a29d-a5dbff3b2593 tempest-GroupSnapshotsTest-765992417 None] Created volume successfully. Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "cinder-82bec344-e114-4f03-ab43-0c620aa45ae7-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-82bec344-e114-4f03-ab43-0c620aa45ae7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "cinder-quobyte-82bec344-e114-4f03-ab43-0c620aa45ae7" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-quobyte-82bec344-e114-4f03-ab43-0c620aa45ae7" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78f5469-b467-421b-9f28-ec179e189c50]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:50 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 Sep 25 16:09:50 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:51 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7" returned: 0 in 0.975s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:51 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7 Sep 25 16:09:51 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:52 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82bec344-e114-4f03-ab43-0c620aa45ae7" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-quobyte-82bec344-e114-4f03-ab43-0c620aa45ae7" released by "delete_volume" :: held 1.879s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (53d10042-6487-48b7-a0d9-6e5889d61132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deabb964-4ecd-46a7-9a81-430edd3c86ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deabb964-4ecd-46a7-9a81-430edd3c86ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796132198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,host='devstack@QuobyteHD#QuobyteHD',id=21daeb8f-99f1-4523-a17a-c5354fa3e15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:53Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b77a3396-cc0b-4cd4-b04d-9ba4476170c0),volume_type_id=b77a3396-cc0b-4cd4-b04d-9ba4476170c0)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f92081-a045-49d5-a89e-a2d66f562f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f92081-a045-49d5-a89e-a2d66f562f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f126ec-1a58-4872-af36-2ff74a5275fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f126ec-1a58-4872-af36-2ff74a5275fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21daeb8f-99f1-4523-a17a-c5354fa3e15e', 'volume_name': 'volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7f11e-ca19-42ca-836f-563463f5f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7f11e-ca19-42ca-836f-563463f5f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0169d066-104f-4024-a71f-e6e00be24fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Volume 21daeb8f-99f1-4523-a17a-c5354fa3e15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e', 'volume_size': 1} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,created_at=2026-09-25T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796132198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109e8f-d0cd-4ee1-bd43-4ecdfc782665,host='devstack@QuobyteHD#QuobyteHD',id=21daeb8f-99f1-4523-a17a-c5354fa3e15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:53Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b77a3396-cc0b-4cd4-b04d-9ba4476170c0),volume_type_id=b77a3396-cc0b-4cd4-b04d-9ba4476170c0)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Creating volume 21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:52 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:53 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e 1073741824 Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Created reservations ['9e00de72-a738-4e74-87aa-fc8521052835', 'e56fd714-470a-4626-a027-42d16299e08e', '449e450c-a327-4063-9636-aa1c5c34fc96', 'd96cc909-cba7-4828-a470-fc2326d484a2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:53 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:53 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:53 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:53 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.537s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Deleted volume successfully. Sep 25 16:09:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-58882923-d6ef-4a9d-829e-4f833b60f58c tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-82bec344-e114-4f03-ab43-0c620aa45ae7-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:54 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e 1073741824" returned: 0 in 1.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:54 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e Sep 25 16:09:54 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:54 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e" returned: 0 in 0.585s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0169d066-104f-4024-a71f-e6e00be24fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f46d449-9afc-40dc-a495-1fc9b1978ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Volume volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e (21daeb8f-99f1-4523-a17a-c5354fa3e15e): created successfully Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f46d449-9afc-40dc-a495-1fc9b1978ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (53d10042-6487-48b7-a0d9-6e5889d61132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-336b1f6f-05c8-401e-9fff-d6474ed1e27e tempest-GroupSnapshotsTest-765992417 None] Created volume successfully. Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Flow 'volume_create_manager' (1299252f-ebd7-4166-b908-feceab571e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f18360b-8410-4ed9-80f4-7e5b49951982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f18360b-8410-4ed9-80f4-7e5b49951982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-561277342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5246b2c99444d80919b3d48cb26cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:56Z,use_quota=True,user_id='f679e337b1f64c57ae9fbe1109e2e573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc180f2-2d92-4fd7-b5d3-b53d7b878046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc180f2-2d92-4fd7-b5d3-b53d7b878046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0c7dd5-dacd-46bb-a052-38c21467b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0c7dd5-dacd-46bb-a052-38c21467b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3', 'volume_name': 'volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78644b9d-e283-46a5-a424-0838ba5856b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78644b9d-e283-46a5-a424-0838ba5856b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb3e17f-742f-436f-88b2-8772985f6d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Volume 3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3', 'volume_size': 1} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-561277342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5246b2c99444d80919b3d48cb26cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:56Z,use_quota=True,user_id='f679e337b1f64c57ae9fbe1109e2e573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Creating volume 3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:09:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:55 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 1073741824 Sep 25 16:09:55 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a811ec3b-8768-4620-843a-aca3ae81b310 tempest-GroupSnapshotsTest-765992417 None] Update group completed successfully. Sep 25 16:09:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-545d117d-385b-4187-b9dc-b848d9c2342d req-330986b4-a3db-4d11-9f0d-3bddf42449b0 tempest-ServerActionsTestOtherA-246211500 None] Terminate volume connection completed successfully. Sep 25 16:09:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-545d117d-385b-4187-b9dc-b848d9c2342d req-330986b4-a3db-4d11-9f0d-3bddf42449b0 tempest-ServerActionsTestOtherA-246211500 None] Deleting attachment 0d7d198b-9992-4f61-8a42-51b90fca79b4. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:09:56 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 1073741824" returned: 0 in 1.026s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:56 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 Sep 25 16:09:56 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-57dd9fc8-76fa-4854-bce7-7168cc806f18 tempest-GroupSnapshotsTest-765992417 None] Update group completed successfully. Sep 25 16:09:57 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb3e17f-742f-436f-88b2-8772985f6d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8e114f-1d67-4762-a670-b5562a7cba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Volume volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 (3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3): created successfully Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8e114f-1d67-4762-a670-b5562a7cba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Flow 'volume_create_manager' (1299252f-ebd7-4166-b908-feceab571e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d989b23d-59eb-4bbb-84f8-3a125eba08d2 tempest-VolumesTransfersV357Test-1350988939 None] Created volume successfully. Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "cinder-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "cinder-quobyte-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-quobyte-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" acquired by "delete_volume" :: waited 0.045s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af578e-9004-4711-a1d9-01a1b4a04b41]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f72e2cf9-7e79-4d1b-8f03-097fa5e1260b tempest-GroupSnapshotsTest-765992417 None] Update group completed successfully. Sep 25 16:09:58 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 Sep 25 16:09:58 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:58 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" returned: 0 in 0.539s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3 Sep 25 16:09:58 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:59 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" returned: 0 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-quobyte-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3" released by "delete_volume" :: held 0.988s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-545d117d-385b-4187-b9dc-b848d9c2342d req-63c15c11-f91c-41b9-be67-6ae1350f1000 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-545d117d-385b-4187-b9dc-b848d9c2342d req-63c15c11-f91c-41b9-be67-6ae1350f1000 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-545d117d-385b-4187-b9dc-b848d9c2342d req-63c15c11-f91c-41b9-be67-6ae1350f1000 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Created reservations ['5029cae4-1c59-4299-b31a-1a5d0dcf10ff', '577217f3-6f8b-4b41-b69e-88f9f264959f', '39a0b975-8a32-46d7-9271-b17ab9ea036c', '606651de-8dd2-4141-b7d3-fac42a566c04'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-545d117d-385b-4187-b9dc-b848d9c2342d req-63c15c11-f91c-41b9-be67-6ae1350f1000 tempest-ServerActionsTestOtherA-246211500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-9586c77c-1262-4400-b937-3b2f2a7c7c42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c8a6056-1946-426d-a85d-8609011e56ed', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-545d117d-385b-4187-b9dc-b848d9c2342d req-63c15c11-f91c-41b9-be67-6ae1350f1000 tempest-ServerActionsTestOtherA-246211500 None] attachment_update completed successfully. Sep 25 16:09:59 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:09:59 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ea86c8c7-69fa-4ec3-ac91-092007615fdf tempest-GroupSnapshotsTest-765992417 None] Update group completed successfully. Sep 25 16:10:00 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.506s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:00 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Deleted volume successfully. Sep 25 16:10:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4dc99c08-0d0d-42f7-a05f-297b89ee8397 tempest-VolumesTransfersV357Test-943636131 None] Lock "cinder-3e4d2c93-f32f-4bb9-b00e-c9a16db08fe3-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] GroupSnapshot 9998406d-f63b-4f7d-958f-127a5ef06669: creating. Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Group snapshot 9998406d-f63b-4f7d-958f-127a5ef06669: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Creating offline snapshot 128d9074-a966-4453-b867-b73002405751 of volume e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dc0e49-7dbb-4ddc-b781-245be09d5ab9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:02 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd Sep 25 16:10:02 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:03 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:03 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 1G Sep 25 16:10:03 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:03 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 1G" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e729842c-343f-43af-b24f-88a5eb1ca7dd -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:03 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e729842c-343f-43af-b24f-88a5eb1ca7dd -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 Sep 25 16:10:03 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:04 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e729842c-343f-43af-b24f-88a5eb1ca7dd -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751" returned: 0 in 0.470s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:04 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:04 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 Sep 25 16:10:04 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:04 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751" returned: 0 in 0.593s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:05 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info Sep 25 16:10:05 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:05 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info" returned: 0 in 0.521s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:05 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:05 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info Sep 25 16:10:05 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:05 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.info" returned: 0 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.562s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Creating offline snapshot bb3ed397-d534-4b7c-a776-794016fc687a of volume 21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15f451-e152-40c3-9b0c-8c544c108277]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:06 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:06 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:06 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e Sep 25 16:10:06 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:06 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:10:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:10:06 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e" returned: 0 in 1.013s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:07 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a 1G Sep 25 16:10:07 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:07 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a 1G" returned: 0 in 0.910s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:07 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a Sep 25 16:10:07 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:08 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a" returned: 0 in 0.616s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:08 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:08 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a Sep 25 16:10:08 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:08 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a" returned: 0 in 0.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:09 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info Sep 25 16:10:09 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:09 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info" returned: 0 in 0.457s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:09 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:09 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info Sep 25 16:10:09 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:09 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.info" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.086s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-28893699-56b9-4079-b5cb-dc9a3398094a tempest-GroupSnapshotsTest-765992417 None] group_snapshot 9998406d-f63b-4f7d-958f-127a5ef06669: created successfully Sep 25 16:10:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] group_snapshot 9998406d-f63b-4f7d-958f-127a5ef06669: deleting Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] group_snapshot 9998406d-f63b-4f7d-958f-127a5ef06669: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-128d9074-a966-4453-b867-b73002405751" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-128d9074-a966-4453-b867-b73002405751" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Deleting offline snapshot 128d9074-a966-4453-b867-b73002405751 of volume e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] snapshot_file for this snap is: volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f4ff76-88e0-4571-94e4-6984d3f45e48]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:11 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 Sep 25 16:10:11 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:12 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751" returned: 0 in 0.562s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e729842c-343f-43af-b24f-88a5eb1ca7dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[76083eee-2868-474c-aca5-07eb935758c6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:12 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd Sep 25 16:10:12 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:12 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd" returned: 0 in 0.453s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:12 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 Sep 25 16:10:12 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:13 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751" returned: 0 in 0.428s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:13 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751 Sep 25 16:10:13 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:13 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd.128d9074-a966-4453-b867-b73002405751" returned: 0 in 0.291s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-128d9074-a966-4453-b867-b73002405751" released by "_delete_snapshot" :: held 1.890s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" released by "delete_snapshot" :: held 1.933s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-bb3ed397-d534-4b7c-a776-794016fc687a" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-bb3ed397-d534-4b7c-a776-794016fc687a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Deleting offline snapshot bb3ed397-d534-4b7c-a776-794016fc687a of volume 21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] snapshot_file for this snap is: volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce0844-ceab-4732-8601-b22f0893f78d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:13 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a Sep 25 16:10:13 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Flow 'volume_create_manager' (0cf49c84-86d2-4662-9d59-55a1c46d6a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5249118-bb19-44bb-ab50-f92abe9dc781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5249118-bb19-44bb-ab50-f92abe9dc781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-198944705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b0587d-aaa8-4116-9f27-eb4212084c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afefd7b0f85498aae9654456eaa430e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:14Z,use_quota=True,user_id='a81a82a29c744ee39a75e924d9b10a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffafc791-895d-4534-b1b9-475ff5c63f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffafc791-895d-4534-b1b9-475ff5c63f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6b4662-344b-4582-b2ec-46572885e21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:10:14 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a" returned: 0 in 0.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c27cfa-34a7-47b6-a082-a1d504f0f365]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:14 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e Sep 25 16:10:14 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6b4662-344b-4582-b2ec-46572885e21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6b0587d-aaa8-4116-9f27-eb4212084c81', 'volume_name': 'volume-f6b0587d-aaa8-4116-9f27-eb4212084c81', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c297021-2d8c-460a-8e98-50d3ce6f3272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c297021-2d8c-460a-8e98-50d3ce6f3272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c0829f-2cb2-4fbd-a8ec-b5ef2316a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Volume f6b0587d-aaa8-4116-9f27-eb4212084c81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6b0587d-aaa8-4116-9f27-eb4212084c81', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Trying to clone f6b0587d-aaa8-4116-9f27-eb4212084c81 from image a5d467e0-719a-49cf-b176-4393aa2e5a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:10:14 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e" returned: 0 in 0.530s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:14 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a Sep 25 16:10:14 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:10:14 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4be50-7b6f-469e-a6e7-2422090b0597]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:15 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD Sep 25 16:10:15 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:15 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a" returned: 0 in 0.566s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:15 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a Sep 25 16:10:15 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:15 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d is fetched for user a81a82a29c744ee39a75e924d9b10a49. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a62ad2-df15-4ea5-baac-d644e0a84418]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:15 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD Sep 25 16:10:15 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:15 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e.bb3ed397-d534-4b7c-a776-794016fc687a" returned: 0 in 0.323s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-bb3ed397-d534-4b7c-a776-794016fc687a" released by "_delete_snapshot" :: held 2.071s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" released by "delete_snapshot" :: held 2.106s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:15 devstack cinder-volume[87199]: WARNING cinder.quota [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-144337593 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-144337593, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:15 devstack cinder-volume[87199]: WARNING cinder.quota [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-144337593 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-144337593, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Created reservations ['926b693a-69be-44e5-838e-47ee2849821b', '0fbf169a-7c60-4f9e-9b9b-3e979253715f', '028fbefd-3d25-4cc6-a524-aac186e016f1', 'c452dcb4-06f9-46d4-9533-496abed53761'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:15 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-198944705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b0587d-aaa8-4116-9f27-eb4212084c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afefd7b0f85498aae9654456eaa430e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:14Z,use_quota=True,user_id='a81a82a29c744ee39a75e924d9b10a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Creating volume f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:15 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:16 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1073741824 Sep 25 16:10:16 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] Created reservations ['df71774e-ff28-479f-9c0c-b8735d0164af', '297a1d34-bda8-4b2c-af92-7ba5a0416a9c', 'd99b1a9b-a777-4451-9e96-11330deb3bda', 'ff065c2c-db11-487a-a2e2-074ec12147f5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7498c7f1-c926-4351-8807-3a277c4a9f5e tempest-GroupSnapshotsTest-765992417 None] group_snapshot 9998406d-f63b-4f7d-958f-127a5ef06669: deleted successfully Sep 25 16:10:16 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1073741824" returned: 0 in 0.643s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:16 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 Sep 25 16:10:16 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d86858-2a15-4ed1-a78b-321dac3d0bc4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:16 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81" returned: 0 in 0.334s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Attempting download of a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume f6b0587d-aaa8-4116-9f27-eb4212084c81. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:10:17 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e Sep 25 16:10:17 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62de8c2-9e3d-43d7-a0bb-ff644e48b593]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:17 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t Sep 25 16:10:17 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:17 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e" returned: 0 in 0.514s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:17 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e Sep 25 16:10:17 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:17 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:17 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t Sep 25 16:10:17 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:17 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21daeb8f-99f1-4523-a17a-c5354fa3e15e" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-21daeb8f-99f1-4523-a17a-c5354fa3e15e" released by "delete_volume" :: held 0.909s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f426f9f-248e-4a69-865a-13a6f966e21f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:17 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t" returned: 1 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_aa9p1t2t' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b3108d-22cc-47d2-b36e-9a68843646f6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:18 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd Sep 25 16:10:18 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:18 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD Sep 25 16:10:18 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:18 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd" returned: 0 in 0.533s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:18 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd Sep 25 16:10:18 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:18 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD" returned: 0 in 0.604s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] a5d467e0-719a-49cf-b176-4393aa2e5a8d was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:18 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 Sep 25 16:10:18 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:18 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e729842c-343f-43af-b24f-88a5eb1ca7dd" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-e729842c-343f-43af-b24f-88a5eb1ca7dd" released by "delete_volume" :: held 0.880s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['aa162b0e-86ff-4854-9804-273329ee023e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:18 devstack cinder-volume[87199]: WARNING cinder.quota [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-144337593 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-144337593, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['08d032d6-3b98-48e8-947e-cf3baac64ce9', '964c5713-1a45-4582-881b-e0263ecc3ad9', '88c9df8f-a261-4c0b-8390-fd628dd7e6b3', '9bd0726d-8072-45b8-be25-1273f1b2b55e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['dfb85ccd-cc35-4a28-b3cb-d554d63047a6', '5d1fd042-e5c7-4aec-9c06-ac3675ecb768', '64e51288-ae10-4c14-9792-0d0a52289144', 'f5dfaff8-7340-489c-9be2-783cff4085a9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:19 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:19 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:19 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.435s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d8371f2e-dc1a-4325-a5f0-a4840c402563 tempest-GroupSnapshotsTest-765992417 None] Delete group completed successfully. Sep 25 16:10:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aaca0dbe-7d09-4813-a719-99ec04973f39 tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1262727952: creating Sep 25 16:10:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aaca0dbe-7d09-4813-a719-99ec04973f39 tempest-GroupSnapshotsTest-765992417 None] Group tempest-GroupSnapshotsTest-Group-1262727952: created successfully Sep 25 16:10:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aaca0dbe-7d09-4813-a719-99ec04973f39 tempest-GroupSnapshotsTest-765992417 None] Create group completed successfully. Sep 25 16:10:21 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81" returned: 0 in 2.544s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ooj5v8oudevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:10:21 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Converted 112.00 MB image at 44.01 MB/s Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:21 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1G Sep 25 16:10:21 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:21 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 1G" returned: 0 in 0.429s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Downloaded image a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume f6b0587d-aaa8-4116-9f27-eb4212084c81 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d for user a81a82a29c744ee39a75e924d9b10a49 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Marking volume f6b0587d-aaa8-4116-9f27-eb4212084c81 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Copying metadata from image a5d467e0-719a-49cf-b176-4393aa2e5a8d to f6b0587d-aaa8-4116-9f27-eb4212084c81. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Creating volume glance metadata for volume f6b0587d-aaa8-4116-9f27-eb4212084c81 backed by image a5d467e0-719a-49cf-b176-4393aa2e5a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c0829f-2cb2-4fbd-a8ec-b5ef2316a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b0587d-aaa8-4116-9f27-eb4212084c81', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e9985-128d-41bc-a653-bc5926335bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Volume volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 (f6b0587d-aaa8-4116-9f27-eb4212084c81): created successfully Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e9985-128d-41bc-a653-bc5926335bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Flow 'volume_create_manager' (0cf49c84-86d2-4662-9d59-55a1c46d6a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a9122b49-d20e-491a-b9d5-f3fcb8026646 tempest-VolumesExtendTest-1539751647 None] Created volume successfully. Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (7d516ea4-cd6a-4416-821a-af502aec063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2813ac-1bb3-4684-9079-a9191bc66b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2813ac-1bb3-4684-9079-a9191bc66b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42583659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55af7098-3365-433d-8ae2-3e0ee6da1dae,host='devstack@QuobyteHD#QuobyteHD',id=75f40e44-ad0e-4c61-9e18-eb0792a78f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:22Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3730048-ea91-46f5-843f-f819dc2c9a8f),volume_type_id=d3730048-ea91-46f5-843f-f819dc2c9a8f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58a5d56-d407-42fb-b810-8b5b1decbac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58a5d56-d407-42fb-b810-8b5b1decbac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a503fd9-f31b-49d2-82f0-71c314800c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a503fd9-f31b-49d2-82f0-71c314800c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f40e44-ad0e-4c61-9e18-eb0792a78f2b', 'volume_name': 'volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8056d38c-18dd-4bb7-9396-c14bbdfcc9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8056d38c-18dd-4bb7-9396-c14bbdfcc9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25efbd-3e66-4c67-88fa-3d7e070c9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Volume 75f40e44-ad0e-4c61-9e18-eb0792a78f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b', 'volume_size': 1} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55af7098-3365-433d-8ae2-3e0ee6da1dae,created_at=2026-09-25T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42583659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55af7098-3365-433d-8ae2-3e0ee6da1dae,host='devstack@QuobyteHD#QuobyteHD',id=75f40e44-ad0e-4c61-9e18-eb0792a78f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb280ffcd44543ceb9a84288b801f4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:22Z,use_quota=True,user_id='a8996b18106b498d873b79f7f17d0b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3730048-ea91-46f5-843f-f819dc2c9a8f),volume_type_id=d3730048-ea91-46f5-843f-f819dc2c9a8f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Creating volume 75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:22 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:22 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b 1073741824 Sep 25 16:10:22 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:22 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b 1073741824" returned: 0 in 0.521s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:22 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b Sep 25 16:10:22 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:23 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" returned: 0 in 0.337s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.055s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25efbd-3e66-4c67-88fa-3d7e070c9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f119dea-f707-4496-a3e9-c30ebf7ef7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d3b6cc-806e-4594-a2eb-325383d9ae5b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Volume volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b (75f40e44-ad0e-4c61-9e18-eb0792a78f2b): created successfully Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f119dea-f707-4496-a3e9-c30ebf7ef7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Flow 'volume_create_manager' (7d516ea4-cd6a-4416-821a-af502aec063e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d9ed8c1-80bc-4f92-9fee-7bf1bdd0e662 tempest-GroupSnapshotsTest-765992417 None] Created volume successfully. Sep 25 16:10:23 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 Sep 25 16:10:23 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] GroupSnapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: creating. Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Group snapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:10:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:23 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81" returned: 0 in 0.700s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 2G" returned: 0 in 0.144s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.886s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.179s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Creating offline snapshot 609e71bd-33af-4616-b62d-0601e25f086e of volume 75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[93470d41-42a7-4186-ab78-016e88596d84]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-040c5fc6-18c3-490d-b6a6-0d5d06c3d3e5 tempest-VolumesExtendTest-1539751647 None] Extend volume completed successfully. Sep 25 16:10:24 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b Sep 25 16:10:24 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-f6b0587d-aaa8-4116-9f27-eb4212084c81-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-f6b0587d-aaa8-4116-9f27-eb4212084c81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:24 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" returned: 0 in 0.679s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:24 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e 1G Sep 25 16:10:24 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-quobyte-f6b0587d-aaa8-4116-9f27-eb4212084c81" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-f6b0587d-aaa8-4116-9f27-eb4212084c81" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3b8a7-e9fb-41c7-a0ea-578e01470317]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:25 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 Sep 25 16:10:25 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:25 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:25 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e 1G" returned: 0 in 0.918s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:25 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81 Sep 25 16:10:25 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:25 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e Sep 25 16:10:25 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:26 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f6b0587d-aaa8-4116-9f27-eb4212084c81" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-f6b0587d-aaa8-4116-9f27-eb4212084c81" released by "delete_volume" :: held 1.281s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Created reservations ['7a070421-b9c1-4d39-b243-f886329e92af', 'bd79870a-8311-4f9e-b829-ea2b9ae348e3', '83709f1f-8b01-4c20-9fee-f1ebd31901cf', '9afe727a-dfea-4216-a681-f65fa86c15e7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:26 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e" returned: 0 in 0.570s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:26 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:26 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e Sep 25 16:10:26 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:26 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:26 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:26 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e" returned: 0 in 0.451s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:26 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info Sep 25 16:10:26 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:26 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.383s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:26 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Deleted volume successfully. Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-eb571d61-ddd5-45f6-b0ff-b233b16955b6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-f6b0587d-aaa8-4116-9f27-eb4212084c81-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:27 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:27 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:27 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info Sep 25 16:10:27 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:27 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.info" returned: 0 in 0.393s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:27 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=118,cinder:SELECT=129,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4814ec70-4517-4a32-9c2d-7a152a976f36 tempest-GroupSnapshotsTest-765992417 None] group_snapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: created successfully Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=120,cinder:UPDATE=122,cinder:INSERT=31,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Flow 'volume_create_manager' (a108652e-69a1-4e33-9e22-3f5dc8a51b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13420233-a475-4435-8d01-a5623e24b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13420233-a475-4435-8d01-a5623e24b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1699836298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03ed11e-65af-4db3-a938-fec7c645e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afefd7b0f85498aae9654456eaa430e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:28Z,use_quota=True,user_id='a81a82a29c744ee39a75e924d9b10a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30869778-5b53-4b14-b290-95fcaace7f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30869778-5b53-4b14-b290-95fcaace7f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c78400-5df5-4381-a475-d8a8a9c147b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c78400-5df5-4381-a475-d8a8a9c147b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03ed11e-65af-4db3-a938-fec7c645e610', 'volume_name': 'volume-d03ed11e-65af-4db3-a938-fec7c645e610', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2a98a-f652-45ff-b446-8a15aa1e57dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2a98a-f652-45ff-b446-8a15aa1e57dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2eed49-0db8-46a7-86cf-32757c29b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Volume d03ed11e-65af-4db3-a938-fec7c645e610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03ed11e-65af-4db3-a938-fec7c645e610', 'volume_size': 1} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1699836298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03ed11e-65af-4db3-a938-fec7c645e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afefd7b0f85498aae9654456eaa430e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:28Z,use_quota=True,user_id='a81a82a29c744ee39a75e924d9b10a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Creating volume d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:28 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 1073741824 Sep 25 16:10:28 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] group_snapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: deleting Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] group_snapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-609e71bd-33af-4616-b62d-0601e25f086e" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-609e71bd-33af-4616-b62d-0601e25f086e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Deleting offline snapshot 609e71bd-33af-4616-b62d-0601e25f086e of volume 75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] snapshot_file for this snap is: volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e627eef9-b139-400e-84c2-b8dfda4bda13]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:29 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e Sep 25 16:10:29 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:29 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 1073741824" returned: 0 in 0.810s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:29 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:29 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:29 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e" returned: 0 in 0.626s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6891f408-26ab-4909-aac1-cc2783bfbf43]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:29 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b Sep 25 16:10:29 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:29 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2eed49-0db8-46a7-86cf-32757c29b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03ed11e-65af-4db3-a938-fec7c645e610', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3440e3e-ff6f-4db8-9e86-7a144d031e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Volume volume-d03ed11e-65af-4db3-a938-fec7c645e610 (d03ed11e-65af-4db3-a938-fec7c645e610): created successfully Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3440e3e-ff6f-4db8-9e86-7a144d031e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Flow 'volume_create_manager' (a108652e-69a1-4e33-9e22-3f5dc8a51b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-39f7b6b4-f1f0-45e4-89e8-ad0e0296b85a tempest-VolumesExtendTest-1539751647 None] Created volume successfully. Sep 25 16:10:29 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" returned: 0 in 0.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:29 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e Sep 25 16:10:29 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:30 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e" returned: 0 in 0.391s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:30 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e Sep 25 16:10:30 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:30 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b.609e71bd-33af-4616-b62d-0601e25f086e" returned: 0 in 0.338s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-609e71bd-33af-4616-b62d-0601e25f086e" released by "_delete_snapshot" :: held 1.916s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" released by "delete_snapshot" :: held 1.979s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Creating offline snapshot caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 of volume d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa4fb7-7ac2-4ee7-b94b-baa82e124c76]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:30 devstack cinder-volume[87199]: WARNING cinder.quota [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-725320326 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-725320326, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:30 devstack cinder-volume[87199]: WARNING cinder.quota [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-725320326 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-725320326, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:30 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] Created reservations ['7320d37d-c8b8-495b-a722-8805c4063420', '3925ac70-a642-478b-8fb0-9630df459932', '8600117d-2ab6-4219-8587-d98e069f9a2a', '26797e45-ff12-4f2f-b25e-48da36b5b062'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:30 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:30 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5b0df4ec-dd45-4cdc-9f2c-b5d3f651b45d tempest-GroupSnapshotsTest-765992417 None] group_snapshot a2e03a78-a8ad-4453-855e-b67739ea6a99: deleted successfully Sep 25 16:10:31 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.532s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:31 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 1G Sep 25 16:10:31 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Acquiring lock "cinder-da0a75b5-da2c-436b-b9c2-da6baf3df41c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "cinder-da0a75b5-da2c-436b-b9c2-da6baf3df41c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" acquired by "delete_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Acquiring lock "cinder-quobyte-da0a75b5-da2c-436b-b9c2-da6baf3df41c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "cinder-quobyte-da0a75b5-da2c-436b-b9c2-da6baf3df41c" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec17cc0-5421-46b8-8972-42dd02a78f23]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df3ebd-7b68-423d-94eb-68b4a3877101]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:31 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b Sep 25 16:10:31 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:31 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c Sep 25 16:10:31 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:31 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 1G" returned: 0 in 0.627s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03ed11e-65af-4db3-a938-fec7c645e610 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:31 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03ed11e-65af-4db3-a938-fec7c645e610 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 Sep 25 16:10:31 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:32 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c" returned: 0 in 0.482s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" returned: 0 in 0.539s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c Sep 25 16:10:32 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:32 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b Sep 25 16:10:32 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:32 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03ed11e-65af-4db3-a938-fec7c645e610 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" returned: 0 in 0.489s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 is being set with open permissions: ugo+rw Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 Sep 25 16:10:32 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:32 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-da0a75b5-da2c-436b-b9c2-da6baf3df41c" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "cinder-quobyte-da0a75b5-da2c-436b-b9c2-da6baf3df41c" released by "delete_volume" :: held 0.913s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:32 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" returned: 0 in 0.393s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Lock "cinder-quobyte-75f40e44-ad0e-4c61-9e18-eb0792a78f2b" released by "delete_volume" :: held 1.055s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Created reservations ['1ab0e9eb-8bd8-421d-b3a9-a5a52fdf1461', 'eecf998f-d05f-4fc6-be91-ec2993fd6a0b', '2a7a6d88-0894-4c52-8e44-181201563460', '66d4adbb-4e28-4eeb-83d0-5c2256aa770f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:32 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['1540484d-e774-4d2e-9a0a-9b689546fa92'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:32 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:32 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:32 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info Sep 25 16:10:32 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:33 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-725320326 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-725320326, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Created reservations ['52511ec8-21de-4c89-bd3c-209df0cd548d', '6a01cbba-30f2-4705-a23b-ddcf7c2771f5', '2df9499a-8226-47d9-adbe-78618aee427a', '7b956b48-ab91-4218-a008-00a3b05b7294'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:33 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:33 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:33 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Deleted volume successfully. Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06578fc5-21de-48e2-89b4-b377534d755d tempest-AttachVolumeShelveTestJSON-30055082 None] Lock "cinder-da0a75b5-da2c-436b-b9c2-da6baf3df41c-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:33 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info" returned: 0 in 0.391s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info is being set with open permissions: ugo+rw Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:33 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info Sep 25 16:10:33 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:33 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0e4a465f-e340-4241-a248-f78e727baf23 tempest-GroupSnapshotsTest-765992417 None] Delete group completed successfully. Sep 25 16:10:33 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.info" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1d1df69a-25cd-4e5b-b03f-714359710dfd tempest-VolumesExtendTest-1539751647 None] Create snapshot completed successfully Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace2311c-560f-4c72-9d71-4d879bd1e089]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:34 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:34 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:34 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 2G" returned: 0 in 0.197s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.970s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5fb061f0-8bdf-4d7c-80f6-abda6ccb8c5a tempest-VolumesExtendTest-1539751647 None] Extend volume completed successfully. Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-quobyte-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Deleting offline snapshot caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 of volume d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] snapshot_file for this snap is: volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[93957249-e4cb-4ae3-a292-9a6b6c2dfc65]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:35 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 Sep 25 16:10:35 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:36 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03ed11e-65af-4db3-a938-fec7c645e610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e8c57-8723-483c-869a-e23367cbc437]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:36 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:36 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:37 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 Sep 25 16:10:37 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:37 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53 Sep 25 16:10:37 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:38 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610.caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53" released by "_delete_snapshot" :: held 2.605s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" released by "delete_snapshot" :: held 2.655s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Created reservations ['c316238d-b779-444e-baca-71c3e67eb5df', '449b0f0e-2ccd-4772-80a4-2f1cb6cfca6c', '78184464-6014-49aa-b7ef-8e313ba9cfdb', 'b0817a5e-fe7b-4e16-9783-a5a793a3becf'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Delete snapshot completed successfully. Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0da71ea4-a909-4baf-97e1-2c941db91a77 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-caa6bd3d-87e9-48dd-8ab4-b6ffc0730e53-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-d03ed11e-65af-4db3-a938-fec7c645e610-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-d03ed11e-65af-4db3-a938-fec7c645e610-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0e7ab-9f2a-4d82-bb94-d981dd60ce8f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:39 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:39 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.536s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:39 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610 Sep 25 16:10:39 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d03ed11e-65af-4db3-a938-fec7c645e610" returned: 0 in 0.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-quobyte-d03ed11e-65af-4db3-a938-fec7c645e610" released by "delete_volume" :: held 0.962s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Created reservations ['e34f449a-5725-4fa7-82be-4b322bfc8729', '29d39ed6-2b96-4189-a2f3-4a58da7dc437', 'e18f90c9-c786-4516-9b4a-7869e7c25cad', 'ddb4dacc-dba6-45e9-8054-18901e58eedb'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:40 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:40 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.421s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Deleted volume successfully. Sep 25 16:10:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d80fa51f-dda4-4c97-a4eb-05c03d2cb7f6 tempest-VolumesExtendTest-1539751647 None] Lock "cinder-d03ed11e-65af-4db3-a938-fec7c645e610-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (c5f5b8ab-cee4-4cfa-85a1-b0e22d0739a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50d0c93-2c83-471b-ae38-0c1ca12f13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50d0c93-2c83-471b-ae38-0c1ca12f13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220668647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4de696-3e65-41b6-9202-48e668b3a3f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:48Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937989b1-22f3-452a-8a39-38be4c662615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937989b1-22f3-452a-8a39-38be4c662615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6ec2eb-bc75-4cec-b735-f1b20f99ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6ec2eb-bc75-4cec-b735-f1b20f99ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4de696-3e65-41b6-9202-48e668b3a3f8', 'volume_name': 'volume-fe4de696-3e65-41b6-9202-48e668b3a3f8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abec80ec-95d5-4569-b215-df424d87f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abec80ec-95d5-4569-b215-df424d87f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2284fcaa-7338-4bf7-b17e-1876093f8eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Volume fe4de696-3e65-41b6-9202-48e668b3a3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4de696-3e65-41b6-9202-48e668b3a3f8', 'volume_size': 1} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220668647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4de696-3e65-41b6-9202-48e668b3a3f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:48Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Creating volume fe4de696-3e65-41b6-9202-48e668b3a3f8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:48 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:48 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 1073741824 Sep 25 16:10:48 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:49 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 1073741824" returned: 0 in 0.886s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:49 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 Sep 25 16:10:49 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:49 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2284fcaa-7338-4bf7-b17e-1876093f8eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4de696-3e65-41b6-9202-48e668b3a3f8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d8e7b7-077a-44bc-9c39-2947b6b1693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Volume volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 (fe4de696-3e65-41b6-9202-48e668b3a3f8): created successfully Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d8e7b7-077a-44bc-9c39-2947b6b1693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (c5f5b8ab-cee4-4cfa-85a1-b0e22d0739a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1ddd829f-c55f-4041-912b-fac7f0349769 tempest-VolumesListTestJSON-68597273 None] Created volume successfully. Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (ee141497-9687-456c-a777-31de401dc7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82db8966-fb02-4d4b-835f-1050ccca053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82db8966-fb02-4d4b-835f-1050ccca053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2087805853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba668bb-a39f-4c77-8ca4-04a1fd19ac9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:51Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab180fdb-df0b-4a60-907b-247263e9bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab180fdb-df0b-4a60-907b-247263e9bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f508bd8-87c0-4f3c-8754-0a663b58e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f508bd8-87c0-4f3c-8754-0a663b58e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba668bb-a39f-4c77-8ca4-04a1fd19ac9f', 'volume_name': 'volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ec0641-bf9c-4845-a0a5-1ad9545e29a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ec0641-bf9c-4845-a0a5-1ad9545e29a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048db80d-a760-49a4-89c6-ac2b3a203b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Volume bba668bb-a39f-4c77-8ca4-04a1fd19ac9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f', 'volume_size': 1} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2087805853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba668bb-a39f-4c77-8ca4-04a1fd19ac9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:51Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Creating volume bba668bb-a39f-4c77-8ca4-04a1fd19ac9f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:51 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f 1073741824 Sep 25 16:10:51 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:52 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f 1073741824" returned: 0 in 0.657s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:52 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f Sep 25 16:10:52 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-401e9689-8640-47cf-8d2f-6f0fba16d92b tempest-ServerActionsTestOtherA-246211500 None] Terminate volume connection completed successfully. Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-401e9689-8640-47cf-8d2f-6f0fba16d92b tempest-ServerActionsTestOtherA-246211500 None] Deleting attachment 4c8a6056-1946-426d-a85d-8609011e56ed. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:10:52 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048db80d-a760-49a4-89c6-ac2b3a203b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193befb9-909c-4511-8898-bd40de709fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Volume volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f (bba668bb-a39f-4c77-8ca4-04a1fd19ac9f): created successfully Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193befb9-909c-4511-8898-bd40de709fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (ee141497-9687-456c-a777-31de401dc7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c2ea8047-5b08-4e98-91d8-257d9004e1e6 tempest-VolumesListTestJSON-68597273 None] Created volume successfully. Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "cinder-9586c77c-1262-4400-b937-3b2f2a7c7c42-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-9586c77c-1262-4400-b937-3b2f2a7c7c42-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "cinder-quobyte-9586c77c-1262-4400-b937-3b2f2a7c7c42" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-quobyte-9586c77c-1262-4400-b937-3b2f2a7c7c42" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394607a-57cf-45f4-b4f7-19ca98e8aeb0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:53 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 Sep 25 16:10:53 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42" returned: 0 in 1.006s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:54 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42 Sep 25 16:10:54 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (fa29abb2-a7ad-44b5-b349-504e23d771dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8a7e7-41ee-4147-bf22-a0501cd709f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8a7e7-41ee-4147-bf22-a0501cd709f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119696854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38b3175-d4d0-4a8c-a7ab-876efeb6302a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:54Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f777f0-03f3-4be6-9db8-e9675add65c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f777f0-03f3-4be6-9db8-e9675add65c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40131a8-8843-4786-b62d-debefea5d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40131a8-8843-4786-b62d-debefea5d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38b3175-d4d0-4a8c-a7ab-876efeb6302a', 'volume_name': 'volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eb9971-7ea7-4245-a7b2-8be927826199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eb9971-7ea7-4245-a7b2-8be927826199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab496f3-c822-48f4-a735-3e3a5f14c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Volume f38b3175-d4d0-4a8c-a7ab-876efeb6302a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a', 'volume_size': 1} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119696854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38b3175-d4d0-4a8c-a7ab-876efeb6302a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3448a7ca30f34266afdc34f92a210deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:54Z,use_quota=True,user_id='386953c3292f42d3a43e5e1942eb833f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Creating volume f38b3175-d4d0-4a8c-a7ab-876efeb6302a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-9586c77c-1262-4400-b937-3b2f2a7c7c42" returned: 0 in 0.543s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-quobyte-9586c77c-1262-4400-b937-3b2f2a7c7c42" released by "delete_volume" :: held 1.626s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:54 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a 1073741824 Sep 25 16:10:54 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.quota [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Created reservations ['0a6317f5-4900-4426-a1ec-cd5024491bea', '36a0f50c-1df8-4c8b-934e-b404f4a4e8d2', '07ae9d2c-b0aa-4460-9549-0e01183a096f', '79b1b9a5-57ab-4c12-a37b-90ba63c4dd4a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:55 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.539s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.manager [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Deleted volume successfully. Sep 25 16:10:55 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a 1073741824" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7705a7ac-863c-482c-8626-75773ef0fc6a req-52121379-ac91-4f44-b07e-cfbaf7659bb9 tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-9586c77c-1262-4400-b937-3b2f2a7c7c42-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a Sep 25 16:10:55 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "cinder-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "cinder-quobyte-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-quobyte-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4aa5a2-98c4-4dc2-8fa1-b5dfde793812]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce563062-9aee-42e8-8c03-8ce992bcfd03 tempest-GroupsTest-2025246397 None] Group tempest-Group1-1280054234: creating Sep 25 16:10:56 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" returned: 0 in 0.381s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab496f3-c822-48f4-a735-3e3a5f14c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a84174a-7bc5-4394-a7ce-7685e50b178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce563062-9aee-42e8-8c03-8ce992bcfd03 tempest-GroupsTest-2025246397 None] Group tempest-Group1-1280054234: created successfully Sep 25 16:10:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Volume volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a (f38b3175-d4d0-4a8c-a7ab-876efeb6302a): created successfully Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a84174a-7bc5-4394-a7ce-7685e50b178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 Sep 25 16:10:56 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Flow 'volume_create_manager' (fa29abb2-a7ad-44b5-b349-504e23d771dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce563062-9aee-42e8-8c03-8ce992bcfd03 tempest-GroupsTest-2025246397 None] Create group completed successfully. Sep 25 16:10:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-02790e78-4c65-45dc-92b4-cc83ee20d829 tempest-VolumesListTestJSON-68597273 None] Created volume successfully. Sep 25 16:10:56 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779 Sep 25 16:10:56 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" returned: 0 in 0.286s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-quobyte-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779" released by "delete_volume" :: held 0.867s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Created reservations ['aa4d0c1d-9c4b-4add-97f1-84304da61169', 'c9010342-9c0c-431d-92f8-147884acc234', '2b35d490-43ea-45d7-adf6-dba517b534e4', '44252780-5f68-4099-9169-cefa82e52a3d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:57 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:10:57 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9c6a39bb-1405-459f-bfc6-d859635247dc tempest-GroupsTest-2025246397 None] Group tempest-Group2-288741662: creating Sep 25 16:10:57 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:57 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Deleted volume successfully. Sep 25 16:10:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9c6a39bb-1405-459f-bfc6-d859635247dc tempest-GroupsTest-2025246397 None] Group tempest-Group2-288741662: created successfully Sep 25 16:10:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6065167-f620-49fc-8d3d-a82749ccc0fa tempest-ServerActionsTestOtherA-246211500 None] Lock "cinder-cdcfbe7a-3450-4bbb-b721-c8b3ffda7779-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9c6a39bb-1405-459f-bfc6-d859635247dc tempest-GroupsTest-2025246397 None] Create group completed successfully. Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (bd54ef2e-f01a-4091-9ea1-f6c65590e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418a0cbf-f2fc-4576-8e4b-1676b8762baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418a0cbf-f2fc-4576-8e4b-1676b8762baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1063371179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4b964cd-de90-44f6-a1cb-153f026b7239,host='devstack@QuobyteHD#QuobyteHD',id=56a27263-3840-452a-bf2a-72ea38b63381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:00Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16221a9f-1427-47da-b3fe-238efb6b05bf),volume_type_id=16221a9f-1427-47da-b3fe-238efb6b05bf)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db1293-42ab-4483-bb6d-d457f7288b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db1293-42ab-4483-bb6d-d457f7288b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72c5970-da7e-433b-9697-27d74276234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72c5970-da7e-433b-9697-27d74276234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a27263-3840-452a-bf2a-72ea38b63381', 'volume_name': 'volume-56a27263-3840-452a-bf2a-72ea38b63381', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252218f8-cf40-4cae-b8ba-2ff7eb2ab46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252218f8-cf40-4cae-b8ba-2ff7eb2ab46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4f1f60-a395-4ba3-bcfa-b28abbe420bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Volume 56a27263-3840-452a-bf2a-72ea38b63381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a27263-3840-452a-bf2a-72ea38b63381', 'volume_size': 1} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4b964cd-de90-44f6-a1cb-153f026b7239,created_at=2026-09-25T14:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1063371179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4b964cd-de90-44f6-a1cb-153f026b7239,host='devstack@QuobyteHD#QuobyteHD',id=56a27263-3840-452a-bf2a-72ea38b63381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:00Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16221a9f-1427-47da-b3fe-238efb6b05bf),volume_type_id=16221a9f-1427-47da-b3fe-238efb6b05bf)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Creating volume 56a27263-3840-452a-bf2a-72ea38b63381 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:59 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:10:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:59 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 1073741824 Sep 25 16:10:59 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:00 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 1073741824" returned: 0 in 1.107s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-f38b3175-d4d0-4a8c-a7ab-876efeb6302a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:01 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 Sep 25 16:11:01 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "cinder-f38b3175-d4d0-4a8c-a7ab-876efeb6302a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-quobyte-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6564930d-0459-4fc1-812d-42b971fdf144]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a Sep 25 16:11:01 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:01 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381" returned: 0 in 0.558s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:01 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4f1f60-a395-4ba3-bcfa-b28abbe420bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a27263-3840-452a-bf2a-72ea38b63381', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b0930-75e8-47d1-a955-e00c356e742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a Sep 25 16:11:01 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Volume volume-56a27263-3840-452a-bf2a-72ea38b63381 (56a27263-3840-452a-bf2a-72ea38b63381): created successfully Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b0930-75e8-47d1-a955-e00c356e742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (bd54ef2e-f01a-4091-9ea1-f6c65590e452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-916cee9e-28d1-4bdc-9dce-bf11cfb62162 tempest-GroupsTest-2025246397 None] Created volume successfully. Sep 25 16:11:02 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" returned: 0 in 0.346s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-f38b3175-d4d0-4a8c-a7ab-876efeb6302a" released by "delete_volume" :: held 0.952s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Created reservations ['764701e4-29c5-4a87-96a0-8102e6249cc5', 'f748aeec-50b3-4ca0-a916-64230a1000d1', '90c241e1-004d-4882-abfc-f89c66b40aa9', 'ac9c3d35-e6d4-4fb3-86bc-72775c415223'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:02 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:02 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:02 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Deleted volume successfully. Sep 25 16:11:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-775e1ab5-7148-4cdd-8026-72a713ffecfb tempest-VolumesListTestJSON-68597273 None] Lock "cinder-f38b3175-d4d0-4a8c-a7ab-876efeb6302a-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Acquiring lock "cinder-quobyte-56a27263-3840-452a-bf2a-72ea38b63381" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-56a27263-3840-452a-bf2a-72ea38b63381" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a1cfc8-d2cf-444f-a0b6-d7f9fece8fc0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:03 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 Sep 25 16:11:03 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-quobyte-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd10f9b-8841-4068-8e1a-2a4dd3fd0adb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:03 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381" returned: 0 in 0.607s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:03 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381 Sep 25 16:11:03 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:03 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f Sep 25 16:11:03 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:04 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56a27263-3840-452a-bf2a-72ea38b63381" returned: 0 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-56a27263-3840-452a-bf2a-72ea38b63381" released by "delete_volume" :: held 1.069s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Created reservations ['a20f8cfe-e0c2-41c4-970d-478a691d1954'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:04 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" returned: 0 in 0.589s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack cinder-volume[87199]: WARNING cinder.quota [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-937858120 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-937858120, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:04 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f Sep 25 16:11:04 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:04 devstack cinder-volume[87199]: WARNING cinder.quota [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-937858120 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-937858120, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Created reservations ['b7eff8a3-de02-4eee-8d7f-c48424de126f', '9f3d9720-4c14-4ae8-9159-e0972a86b6d4', '3168a360-facc-4e3e-976d-c9c1ccdc44b6', '56638673-c0af-4d50-858f-416a567fd955'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:04 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:04 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" returned: 0 in 0.431s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f" released by "delete_volume" :: held 1.095s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Created reservations ['f28383e9-7f96-4933-ab4f-a0be03c99d80', 'fba5f24d-b066-4d24-b326-545f1c14d91f', 'a393ae87-c4d6-4d21-b7b1-73ba21f7256a', '51b181b9-6008-45a1-9236-e552a8a2931d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:05 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.404s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f9bf3cd6-5003-4cf8-a0ee-15f3b0b4e8f5 tempest-GroupsTest-2025246397 None] Delete group completed successfully. Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:05 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:05 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.339s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Deleted volume successfully. Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01644db1-21a6-4b1c-8ff8-8c7efef32a72 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-bba668bb-a39f-4c77-8ca4-04a1fd19ac9f-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Created reservations ['e355210c-b298-4fac-a400-1e7b9ac85074'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:05 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:06 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-fe4de696-3e65-41b6-9202-48e668b3a3f8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-fe4de696-3e65-41b6-9202-48e668b3a3f8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "cinder-quobyte-fe4de696-3e65-41b6-9202-48e668b3a3f8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-fe4de696-3e65-41b6-9202-48e668b3a3f8" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:06 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.507s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1ed92c5c-277e-4ffe-867a-824bf4835b4c tempest-GroupsTest-2025246397 None] Delete group completed successfully. Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ad9f7-dde4-4c17-83e3-1268c2d05235]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.400s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:11:06 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 Sep 25 16:11:06 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8" returned: 0 in 0.528s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8 Sep 25 16:11:06 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:07 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fe4de696-3e65-41b6-9202-48e668b3a3f8" returned: 0 in 0.485s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-quobyte-fe4de696-3e65-41b6-9202-48e668b3a3f8" released by "delete_volume" :: held 1.111s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Created reservations ['2e9cd960-7b95-430e-b119-c9ac1dbb28c0', '0837f608-8dea-4990-afe2-2584564a0dcd', '619f4621-27a2-4565-8e4f-dbfee57ed7b3', '379164a9-5410-4f05-a2ad-8c2f98f733a1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2c8dde84-1184-449e-abb2-1de9a3d8e6ad tempest-GroupsTest-2025246397 None] Group tempest-GroupsTest-Group-892722274: creating Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2c8dde84-1184-449e-abb2-1de9a3d8e6ad tempest-GroupsTest-2025246397 None] Group tempest-GroupsTest-Group-892722274: created successfully Sep 25 16:11:07 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:07 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2c8dde84-1184-449e-abb2-1de9a3d8e6ad tempest-GroupsTest-2025246397 None] Create group completed successfully. Sep 25 16:11:07 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Deleted volume successfully. Sep 25 16:11:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f76a5f4-7136-4ba6-ba5b-a526d9a1d4f9 tempest-VolumesListTestJSON-68597273 None] Lock "cinder-fe4de696-3e65-41b6-9202-48e668b3a3f8-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (351d9eb3-8567-4b6e-809f-beee895c5588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe655ad8-3c0d-4b66-93ea-2841830d7ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe655ad8-3c0d-4b66-93ea-2841830d7ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406549968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84d603e6-9b60-4aa8-bd57-34533c142563,host='devstack@QuobyteHD#QuobyteHD',id=e2def670-94f4-42fe-ba12-c8ea07be48f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:10Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a42ac7-a346-49bf-977a-db57595e9c2f),volume_type_id=67a42ac7-a346-49bf-977a-db57595e9c2f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e513ac-2638-48ec-9ccb-a34099782c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e513ac-2638-48ec-9ccb-a34099782c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612171ed-59eb-4ceb-a379-d2e1a9344542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612171ed-59eb-4ceb-a379-d2e1a9344542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2def670-94f4-42fe-ba12-c8ea07be48f2', 'volume_name': 'volume-e2def670-94f4-42fe-ba12-c8ea07be48f2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d88c160-4ca1-4a2c-81f9-1b3f44ac5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d88c160-4ca1-4a2c-81f9-1b3f44ac5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21579246-62c9-432f-a066-b228fbb73d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Volume e2def670-94f4-42fe-ba12-c8ea07be48f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2def670-94f4-42fe-ba12-c8ea07be48f2', 'volume_size': 1} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84d603e6-9b60-4aa8-bd57-34533c142563,created_at=2026-09-25T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406549968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84d603e6-9b60-4aa8-bd57-34533c142563,host='devstack@QuobyteHD#QuobyteHD',id=e2def670-94f4-42fe-ba12-c8ea07be48f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:10Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a42ac7-a346-49bf-977a-db57595e9c2f),volume_type_id=67a42ac7-a346-49bf-977a-db57595e9c2f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Creating volume e2def670-94f4-42fe-ba12-c8ea07be48f2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:10 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 1073741824 Sep 25 16:11:10 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 1073741824" returned: 0 in 0.812s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 Sep 25 16:11:10 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:11 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21579246-62c9-432f-a066-b228fbb73d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2def670-94f4-42fe-ba12-c8ea07be48f2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590aad9-edcd-4b55-a70e-a057d8f9cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Volume volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 (e2def670-94f4-42fe-ba12-c8ea07be48f2): created successfully Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590aad9-edcd-4b55-a70e-a057d8f9cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (351d9eb3-8567-4b6e-809f-beee895c5588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b11205fd-9855-4c04-b9e5-406afbf01f1e tempest-GroupsTest-2025246397 None] Created volume successfully. Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (9547fa5c-b1f9-480c-a61f-1c2a5d79ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a95120-10e4-4ecf-9c19-26fcad71c170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a95120-10e4-4ecf-9c19-26fcad71c170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069644814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84d603e6-9b60-4aa8-bd57-34533c142563,host='devstack@QuobyteHD#QuobyteHD',id=79c0a986-4317-4ff8-8dea-091cdb98c1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:14Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a42ac7-a346-49bf-977a-db57595e9c2f),volume_type_id=67a42ac7-a346-49bf-977a-db57595e9c2f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5468ca8d-39a2-486e-9870-96885b80cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5468ca8d-39a2-486e-9870-96885b80cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ea2f7-99a6-4708-904a-504119f77284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ea2f7-99a6-4708-904a-504119f77284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c0a986-4317-4ff8-8dea-091cdb98c1db', 'volume_name': 'volume-79c0a986-4317-4ff8-8dea-091cdb98c1db', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256f996a-995c-4139-b3a7-7bdb6bdf290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256f996a-995c-4139-b3a7-7bdb6bdf290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628265cc-79a8-4daf-9da8-a64d0e4b5e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Volume 79c0a986-4317-4ff8-8dea-091cdb98c1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c0a986-4317-4ff8-8dea-091cdb98c1db', 'volume_size': 1} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84d603e6-9b60-4aa8-bd57-34533c142563,created_at=2026-09-25T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069644814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84d603e6-9b60-4aa8-bd57-34533c142563,host='devstack@QuobyteHD#QuobyteHD',id=79c0a986-4317-4ff8-8dea-091cdb98c1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d193ab2792450789945e31c83ac6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:14Z,use_quota=True,user_id='080ee7ea78b64695985033c8ef329d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a42ac7-a346-49bf-977a-db57595e9c2f),volume_type_id=67a42ac7-a346-49bf-977a-db57595e9c2f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Creating volume 79c0a986-4317-4ff8-8dea-091cdb98c1db {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:11:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db 1073741824 Sep 25 16:11:14 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:14 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db 1073741824" returned: 0 in 0.800s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db Sep 25 16:11:14 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db" returned: 0 in 0.503s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628265cc-79a8-4daf-9da8-a64d0e4b5e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c0a986-4317-4ff8-8dea-091cdb98c1db', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4df9f4-c081-4bdf-9504-d9506a893c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Volume volume-79c0a986-4317-4ff8-8dea-091cdb98c1db (79c0a986-4317-4ff8-8dea-091cdb98c1db): created successfully Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4df9f4-c081-4bdf-9504-d9506a893c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Flow 'volume_create_manager' (9547fa5c-b1f9-480c-a61f-1c2a5d79ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b9d9003c-8357-41d0-a4eb-23a9b498d12f tempest-GroupsTest-2025246397 None] Created volume successfully. Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Flow 'volume_create_manager' (50e7c353-8bf8-432a-9f39-a688cc850fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924dc39-1e01-4415-bcec-0834b7e08b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924dc39-1e01-4415-bcec-0834b7e08b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1269377651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e505656f-939f-48a0-920f-ca7611780d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665038bedeed419c94e47b2c521a55f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:16Z,use_quota=True,user_id='2daeceac4fc64617880f1432371b81de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8302dae3-812a-4b42-a919-08460d5b5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8302dae3-812a-4b42-a919-08460d5b5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c7c1d-91dc-4656-99af-6ada08a580c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c7c1d-91dc-4656-99af-6ada08a580c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e505656f-939f-48a0-920f-ca7611780d7c', 'volume_name': 'volume-e505656f-939f-48a0-920f-ca7611780d7c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca64db18-57ef-476a-978a-4bd0234a6361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca64db18-57ef-476a-978a-4bd0234a6361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f6d646-ab53-4787-9cea-1831a3164e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Volume e505656f-939f-48a0-920f-ca7611780d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e505656f-939f-48a0-920f-ca7611780d7c', 'volume_size': 1} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1269377651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e505656f-939f-48a0-920f-ca7611780d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665038bedeed419c94e47b2c521a55f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:16Z,use_quota=True,user_id='2daeceac4fc64617880f1432371b81de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Creating volume e505656f-939f-48a0-920f-ca7611780d7c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:16 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:11:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:16 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c 1073741824 Sep 25 16:11:16 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-260a9e7f-6459-468d-9584-1a0938b5a2b7 tempest-GroupsTest-2025246397 None] Update group completed successfully. Sep 25 16:11:17 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c 1073741824" returned: 0 in 1.131s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c Sep 25 16:11:17 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:18 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c" returned: 0 in 0.582s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f6d646-ab53-4787-9cea-1831a3164e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e505656f-939f-48a0-920f-ca7611780d7c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26677b63-4413-44e5-ada9-80f97d84ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Volume volume-e505656f-939f-48a0-920f-ca7611780d7c (e505656f-939f-48a0-920f-ca7611780d7c): created successfully Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26677b63-4413-44e5-ada9-80f97d84ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Flow 'volume_create_manager' (50e7c353-8bf8-432a-9f39-a688cc850fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-817ec02c-7f2d-4975-945f-ebcf2015e850 tempest-VolumesNegativeTest-278831051 None] Created volume successfully. Sep 25 16:11:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2a9740b2-0499-422a-bfa3-d5542bcecff4 tempest-GroupsTest-2025246397 None] Update group completed successfully. Sep 25 16:11:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Acquiring lock "cinder-quobyte-79c0a986-4317-4ff8-8dea-091cdb98c1db" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-79c0a986-4317-4ff8-8dea-091cdb98c1db" acquired by "delete_volume" :: waited 0.065s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ac63c2-40b9-4bee-872b-17b9ab081dee]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:21 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db Sep 25 16:11:21 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:22 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db" returned: 0 in 1.061s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:22 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db Sep 25 16:11:22 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:22 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-79c0a986-4317-4ff8-8dea-091cdb98c1db" returned: 0 in 0.740s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-79c0a986-4317-4ff8-8dea-091cdb98c1db" released by "delete_volume" :: held 1.999s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Acquiring lock "cinder-quobyte-e2def670-94f4-42fe-ba12-c8ea07be48f2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-e2def670-94f4-42fe-ba12-c8ea07be48f2" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6a617-36cf-46a4-8551-b01dc60f2d9a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:23 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 Sep 25 16:11:23 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2" returned: 0 in 0.916s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2 Sep 25 16:11:24 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e2def670-94f4-42fe-ba12-c8ea07be48f2" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "cinder-quobyte-e2def670-94f4-42fe-ba12-c8ea07be48f2" released by "delete_volume" :: held 1.544s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Created reservations ['d08fde26-e1e3-4599-81ed-21065164dc89'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:24 devstack cinder-volume[87199]: WARNING cinder.quota [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1078728953 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1078728953, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:24 devstack cinder-volume[87199]: WARNING cinder.quota [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1078728953 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1078728953, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Created reservations ['c703eabe-c58c-47a3-ab9b-25382c5e898f', '5b78054e-5790-42c9-9416-b964d2455e5d', '7593285c-a40f-41f0-9e5b-da9b44b195e8', 'd262b61f-7737-4783-b838-892911e46e78'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Created reservations ['57f92640-e8da-470a-be68-d233c4c82729', '129ebf29-7c30-4a7c-bbb7-13c680b36a02', '75790131-1c72-4591-8c74-55f4163b3473', '12d77f3c-fce8-40b1-bdf4-39726e88d311'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:25 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:25 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.394s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:25 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7b5deb18-708a-403b-bcdd-8e12507cc31f tempest-GroupsTest-2025246397 None] Delete group completed successfully. Sep 25 16:11:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=119,cinder:INSERT=36,cinder:UPDATE=137,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=150,cinder:SELECT=107,cinder:DELETE=10,cinder:INSERT=29 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac6625f4-6a8a-4287-a4f4-ecbfdec7593a tempest-GroupsV314Test-1815020582 None] Group tempest-GroupsV314Test-Group-130738272: creating Sep 25 16:11:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac6625f4-6a8a-4287-a4f4-ecbfdec7593a tempest-GroupsV314Test-1815020582 None] Group tempest-GroupsV314Test-Group-130738272: created successfully Sep 25 16:11:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac6625f4-6a8a-4287-a4f4-ecbfdec7593a tempest-GroupsV314Test-1815020582 None] Create group completed successfully. Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Flow 'volume_create_manager' (f891981d-5d3f-4974-a659-a0ec50109cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3daa25c-8a63-4363-b905-b4c131e414fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3daa25c-8a63-4363-b905-b4c131e414fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397399858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5799e385-bbdb-41e3-911e-7b8900395524,host='devstack@QuobyteHD#QuobyteHD',id=eab97e54-6386-44f0-ae52-ffaee55fda11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20395f178cf4dc38c32c52123aa9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:41Z,use_quota=True,user_id='6e400fbd1d3841748b676b2ae26cdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81fd836-101c-46c3-8a21-89e2bc84c3d4),volume_type_id=b81fd836-101c-46c3-8a21-89e2bc84c3d4)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81def8b5-d616-4c74-9143-103d8276c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81def8b5-d616-4c74-9143-103d8276c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3662b0cc-77ef-4ba0-9169-ded27f385498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3662b0cc-77ef-4ba0-9169-ded27f385498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab97e54-6386-44f0-ae52-ffaee55fda11', 'volume_name': 'volume-eab97e54-6386-44f0-ae52-ffaee55fda11', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6532176-f7e2-4089-8413-ec82e57635ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6532176-f7e2-4089-8413-ec82e57635ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9100743-d794-4dd9-b6dd-73b2a6243777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Volume eab97e54-6386-44f0-ae52-ffaee55fda11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab97e54-6386-44f0-ae52-ffaee55fda11', 'volume_size': 1} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5799e385-bbdb-41e3-911e-7b8900395524,created_at=2026-09-25T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397399858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5799e385-bbdb-41e3-911e-7b8900395524,host='devstack@QuobyteHD#QuobyteHD',id=eab97e54-6386-44f0-ae52-ffaee55fda11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20395f178cf4dc38c32c52123aa9a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:41Z,use_quota=True,user_id='6e400fbd1d3841748b676b2ae26cdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81fd836-101c-46c3-8a21-89e2bc84c3d4),volume_type_id=b81fd836-101c-46c3-8a21-89e2bc84c3d4)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Creating volume eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:11:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:40 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 1073741824 Sep 25 16:11:40 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:41 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 1073741824" returned: 0 in 0.579s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:41 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:11:41 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:41 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9100743-d794-4dd9-b6dd-73b2a6243777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab97e54-6386-44f0-ae52-ffaee55fda11', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1890cf45-4972-4a22-90cc-d6e8a593af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Volume volume-eab97e54-6386-44f0-ae52-ffaee55fda11 (eab97e54-6386-44f0-ae52-ffaee55fda11): created successfully Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1890cf45-4972-4a22-90cc-d6e8a593af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Flow 'volume_create_manager' (f891981d-5d3f-4974-a659-a0ec50109cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f5d87e9b-b4dd-440c-836c-839d0a1102b7 tempest-GroupsV314Test-1815020582 None] Created volume successfully. Sep 25 16:11:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Cloning volume eab97e54-6386-44f0-ae52-ffaee55fda11 to volume dae69323-4ae1-4b10-8371-998dd224c518 Sep 25 16:11:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Creating offline snapshot 08ef8437-9e7c-4add-8045-346627324096 of volume eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:11:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0805f32d-7aef-42e6-b589-4d3a624ab537]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:43 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:11:43 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:43 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.648s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:44 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 1G Sep 25 16:11:44 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:44 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 1G" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab97e54-6386-44f0-ae52-ffaee55fda11 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:44 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab97e54-6386-44f0-ae52-ffaee55fda11 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:11:44 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:45 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab97e54-6386-44f0-ae52-ffaee55fda11 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.464s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:11:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:45 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:11:45 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:45 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.336s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:45 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info Sep 25 16:11:45 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:46 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info" returned: 0 in 0.337s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:46 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info Sep 25 16:11:46 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:46 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.info" returned: 0 in 0.363s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Acquiring lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] snapshot: 08ef8437-9e7c-4add-8045-346627324096, volume: dae69323-4ae1-4b10-8371-998dd224c518, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a27ffe-d60b-4603-b5ad-f130443ab600]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:46 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:11:46 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:47 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.535s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab97e54-6386-44f0-ae52-ffaee55fda11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db4b2da-ac38-47ff-a45b-874284348103]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:47 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:11:47 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:47 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.550s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:11:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:47 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 Sep 25 16:11:47 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (deaaaf11-fbac-43f2-abca-b2b4e1d36ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbc96e4-c6d7-48b4-88f4-be17a68ac619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbc96e4-c6d7-48b4-88f4-be17a68ac619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-251868830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855a165e-ef66-44c5-aa5f-0860ceb2790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:51Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9978f4f9-8471-4b69-a6b7-1e26efd238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9978f4f9-8471-4b69-a6b7-1e26efd238d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456bd9ed-1a15-4f96-9359-a1417c9d3341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456bd9ed-1a15-4f96-9359-a1417c9d3341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855a165e-ef66-44c5-aa5f-0860ceb2790e', 'volume_name': 'volume-855a165e-ef66-44c5-aa5f-0860ceb2790e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103192b5-f187-42fe-a46e-3cdeeac47a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103192b5-f187-42fe-a46e-3cdeeac47a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c4cfce-a46f-4948-a74e-c23414dad670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Volume 855a165e-ef66-44c5-aa5f-0860ceb2790e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855a165e-ef66-44c5-aa5f-0860ceb2790e', 'volume_size': 1} Sep 25 16:11:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:55 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Acquiring lock "cinder-e505656f-939f-48a0-920f-ca7611780d7c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "cinder-e505656f-939f-48a0-920f-ca7611780d7c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Acquiring lock "cinder-quobyte-e505656f-939f-48a0-920f-ca7611780d7c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "cinder-quobyte-e505656f-939f-48a0-920f-ca7611780d7c" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c05198-3d13-4b40-bc38-cb3799273c59]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c Sep 25 16:11:56 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c" returned: 0 in 0.769s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c Sep 25 16:11:56 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:57 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e505656f-939f-48a0-920f-ca7611780d7c" returned: 0 in 0.708s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "cinder-quobyte-e505656f-939f-48a0-920f-ca7611780d7c" released by "delete_volume" :: held 1.630s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Created reservations ['3e4816f6-7ba7-4214-894f-4fb7ea19a6c2', '307256e6-ddc8-49ec-86ed-5d3905a2cffb', '734ce45a-5d53-4ea1-a7f1-c90412aeb8fa', '026208b1-acb0-4898-b4d5-486a7ab37e46'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:11:58 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:58 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.552s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Deleted volume successfully. Sep 25 16:11:58 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a41d828f-9f24-496b-91a3-69801ffe1e96 tempest-VolumesNegativeTest-278831051 None] Lock "cinder-e505656f-939f-48a0-920f-ca7611780d7c-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518" returned: 0 in 10.966s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11, size 1024.00 MB, duration 10.97 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:11:58 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Converted 1024.00 MB image at 93.37 MB/s Sep 25 16:11:58 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:11:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 Sep 25 16:11:58 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:59 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518" returned: 0 in 0.480s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" released by "_copy_volume_from_snapshot" :: held 12.660s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Acquiring lock "cinder-quobyte-08ef8437-9e7c-4add-8045-346627324096" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-08ef8437-9e7c-4add-8045-346627324096" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Deleting offline snapshot 08ef8437-9e7c-4add-8045-346627324096 of volume eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] snapshot_file for this snap is: volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8f664-08eb-407f-9ba6-b97890a3241a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:59 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:11:59 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:59 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.599s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab97e54-6386-44f0-ae52-ffaee55fda11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc62af13-1b0f-426b-bb8f-f300470a1bf4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:00 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:12:00 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:00 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:00 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:12:00 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:01 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.647s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:01 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096 Sep 25 16:12:01 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:01 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11.08ef8437-9e7c-4add-8045-346627324096" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-08ef8437-9e7c-4add-8045-346627324096" released by "_delete_snapshot" :: held 2.726s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.704s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.893s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-251868830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855a165e-ef66-44c5-aa5f-0860ceb2790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:51Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Creating volume 855a165e-ef66-44c5-aa5f-0860ceb2790e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:01 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:12:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:02 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e 1073741824 Sep 25 16:12:02 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-408fcc93-4614-4427-8964-4f9b3fec8cfe tempest-GroupsV314Test-1815020582 None] Create group from source-group-5799e385-bbdb-41e3-911e-7b8900395524 completed successfully. Sep 25 16:12:03 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e 1073741824" returned: 0 in 1.059s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:03 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e Sep 25 16:12:03 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Acquiring lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:03 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0e5d1-0bbb-4e1f-a2fc-df2db5736eb4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e" returned: 0 in 0.544s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c4cfce-a46f-4948-a74e-c23414dad670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855a165e-ef66-44c5-aa5f-0860ceb2790e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ed9c10-2a32-44ab-87a7-65c0105fcfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Volume volume-855a165e-ef66-44c5-aa5f-0860ceb2790e (855a165e-ef66-44c5-aa5f-0860ceb2790e): created successfully Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ed9c10-2a32-44ab-87a7-65c0105fcfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (deaaaf11-fbac-43f2-abca-b2b4e1d36ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-11aafadb-29e5-4c3f-888e-ff456ad19bb3 tempest-AttachVolumeTestJSON-602691155 None] Created volume successfully. Sep 25 16:12:03 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 Sep 25 16:12:03 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:04 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:04 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518 Sep 25 16:12:04 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:04 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dae69323-4ae1-4b10-8371-998dd224c518" returned: 0 in 0.532s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-dae69323-4ae1-4b10-8371-998dd224c518" released by "delete_volume" :: held 1.311s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Created reservations ['19fb1f5c-510e-4aaf-b8b9-d5b1fa021734'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:05 devstack cinder-volume[87199]: WARNING cinder.quota [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-73268965 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-73268965, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:12:05 devstack cinder-volume[87199]: WARNING cinder.quota [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-73268965 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-73268965, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Created reservations ['2db5e917-a8f5-4501-9384-67711114a050', '305b974c-405a-48fa-8b58-f6ab84506ea0', '562a8da4-ab43-4aeb-9bf4-fa3b3f4c727b', '4acef990-1caa-4f5c-bc82-fa0bb86b306d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:05 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:12:05 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:05 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.479s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:05 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-84dd3559-af13-488f-8a03-168643805f8e tempest-GroupsV314Test-1815020582 None] Delete group completed successfully. Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:06 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:12:06 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-dd764dc1-a4af-4235-8b2e-612fcb9e717a req-df748617-6464-45fc-bd30-8fcafe4438e6 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-dd764dc1-a4af-4235-8b2e-612fcb9e717a req-df748617-6464-45fc-bd30-8fcafe4438e6 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-dd764dc1-a4af-4235-8b2e-612fcb9e717a req-df748617-6464-45fc-bd30-8fcafe4438e6 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-dd764dc1-a4af-4235-8b2e-612fcb9e717a req-df748617-6464-45fc-bd30-8fcafe4438e6 tempest-AttachVolumeTestJSON-602691155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-855a165e-ef66-44c5-aa5f-0860ceb2790e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b83dc3d3-fb11-4515-a6cc-47d684f5df5d', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:12:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-dd764dc1-a4af-4235-8b2e-612fcb9e717a req-df748617-6464-45fc-bd30-8fcafe4438e6 tempest-AttachVolumeTestJSON-602691155 None] attachment_update completed successfully. Sep 25 16:12:06 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.421s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Acquiring lock "cinder-quobyte-eab97e54-6386-44f0-ae52-ffaee55fda11" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-eab97e54-6386-44f0-ae52-ffaee55fda11" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[05732a34-9feb-492f-aa5a-602849a35131]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:07 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:12:07 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:07 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.629s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:07 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11 Sep 25 16:12:07 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:08 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eab97e54-6386-44f0-ae52-ffaee55fda11" returned: 0 in 0.612s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Lock "cinder-quobyte-eab97e54-6386-44f0-ae52-ffaee55fda11" released by "delete_volume" :: held 1.391s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Created reservations ['e469d514-4f67-4a76-be84-1437ff3951d2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Created reservations ['e37ad2e6-1f3c-495a-9001-698b4f6209dd', 'f0b46a98-cf02-4814-b519-7137cc2a0314', '31912292-a6a2-4ff8-a4c1-8db71181cccd', '050e968c-ddc3-4257-9683-dd1ca62a2e1e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:08 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:12:08 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:09 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.459s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3abef6e1-0ac6-4d56-8b64-30f33738f864 tempest-GroupsV314Test-1815020582 None] Delete group completed successfully. Sep 25 16:12:18 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=37,cinder:SELECT=33,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:18 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=38,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (2e28e13a-9d67-4731-bb49-e2c0d0c4c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d300c0-fae6-4347-8081-bfacd137eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d300c0-fae6-4347-8081-bfacd137eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1255916716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaac69d-6d46-4419-9977-efc3abc2827e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:24Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7375d19-a813-42c1-9ff7-2de7ee360566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7375d19-a813-42c1-9ff7-2de7ee360566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b928c2f-e351-4045-94b8-f284db2d9eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b928c2f-e351-4045-94b8-f284db2d9eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaac69d-6d46-4419-9977-efc3abc2827e', 'volume_name': 'volume-3eaac69d-6d46-4419-9977-efc3abc2827e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec1e9b2-ce35-4963-84ec-bf2a4b2f9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec1e9b2-ce35-4963-84ec-bf2a4b2f9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f814c-8cf3-496f-9f38-722571fe8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Volume 3eaac69d-6d46-4419-9977-efc3abc2827e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaac69d-6d46-4419-9977-efc3abc2827e', 'volume_size': 1} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1255916716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaac69d-6d46-4419-9977-efc3abc2827e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:24Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Creating volume 3eaac69d-6d46-4419-9977-efc3abc2827e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:12:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:24 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e 1073741824 Sep 25 16:12:24 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:25 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e 1073741824" returned: 0 in 1.012s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:25 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e Sep 25 16:12:25 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:26 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e" returned: 0 in 0.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f814c-8cf3-496f-9f38-722571fe8c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaac69d-6d46-4419-9977-efc3abc2827e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67c5372-a34d-4271-a5c9-863125b8ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Volume volume-3eaac69d-6d46-4419-9977-efc3abc2827e (3eaac69d-6d46-4419-9977-efc3abc2827e): created successfully Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67c5372-a34d-4271-a5c9-863125b8ae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (2e28e13a-9d67-4731-bb49-e2c0d0c4c473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-22f749e9-cd54-4d82-b636-dd18cc6dd795 tempest-AttachVolumeNegativeTest-1036418157 None] Created volume successfully. Sep 25 16:12:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-cf61032f-42a5-4acc-bd5a-91db6dbef075 req-2531fe02-baa9-494c-b44a-b61f3a8f03b0 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-cf61032f-42a5-4acc-bd5a-91db6dbef075 req-2531fe02-baa9-494c-b44a-b61f3a8f03b0 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-cf61032f-42a5-4acc-bd5a-91db6dbef075 req-2531fe02-baa9-494c-b44a-b61f3a8f03b0 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-cf61032f-42a5-4acc-bd5a-91db6dbef075 req-2531fe02-baa9-494c-b44a-b61f3a8f03b0 tempest-AttachVolumeNegativeTest-1036418157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-3eaac69d-6d46-4419-9977-efc3abc2827e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fd46adc-3d4b-4d23-b5b6-2eb549665053', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:12:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-cf61032f-42a5-4acc-bd5a-91db6dbef075 req-2531fe02-baa9-494c-b44a-b61f3a8f03b0 tempest-AttachVolumeNegativeTest-1036418157 None] attachment_update completed successfully. Sep 25 16:12:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Flow 'volume_create_manager' (2fb14540-26b6-40a4-98d2-ed5491e8c156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea8a2e6-f3cd-4f97-96b6-751fe274bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea8a2e6-f3cd-4f97-96b6-751fe274bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1005441671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db88564-8722-446c-9a91-73faa45887da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c131eee039ab4fa0b9b7a5f334cdc539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:44Z,use_quota=True,user_id='850ce007568b48b3a9486df698166a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db67d95-f451-4972-8cbc-4be086560f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db67d95-f451-4972-8cbc-4be086560f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083082d8-8a25-46bc-9d7d-71da38a17e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083082d8-8a25-46bc-9d7d-71da38a17e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db88564-8722-446c-9a91-73faa45887da', 'volume_name': 'volume-7db88564-8722-446c-9a91-73faa45887da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40165c-3433-4be7-a06c-79b54482fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40165c-3433-4be7-a06c-79b54482fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a26201-fb7c-456b-a561-f109f2a4835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Volume 7db88564-8722-446c-9a91-73faa45887da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db88564-8722-446c-9a91-73faa45887da', 'volume_size': 1} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1005441671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db88564-8722-446c-9a91-73faa45887da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c131eee039ab4fa0b9b7a5f334cdc539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:44Z,use_quota=True,user_id='850ce007568b48b3a9486df698166a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Creating volume 7db88564-8722-446c-9a91-73faa45887da {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:12:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:43 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da 1073741824 Sep 25 16:12:43 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:44 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da 1073741824" returned: 0 in 0.648s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:44 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da Sep 25 16:12:44 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:44 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a26201-fb7c-456b-a561-f109f2a4835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db88564-8722-446c-9a91-73faa45887da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f7c469-e9c3-497c-a3e7-2fd470304807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Volume volume-7db88564-8722-446c-9a91-73faa45887da (7db88564-8722-446c-9a91-73faa45887da): created successfully Sep 25 16:12:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f7c469-e9c3-497c-a3e7-2fd470304807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Flow 'volume_create_manager' (2fb14540-26b6-40a4-98d2-ed5491e8c156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a04189c2-7448-440e-8f8d-a490bc57bf78 tempest-VolumesServicesTestJSON-949728934 None] Created volume successfully. Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Acquiring lock "cinder-7db88564-8722-446c-9a91-73faa45887da-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "cinder-7db88564-8722-446c-9a91-73faa45887da-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Acquiring lock "cinder-quobyte-7db88564-8722-446c-9a91-73faa45887da" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "cinder-quobyte-7db88564-8722-446c-9a91-73faa45887da" acquired by "delete_volume" :: waited 0.056s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e875f817-e852-448e-845b-763a72a741ad]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:46 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da Sep 25 16:12:46 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:47 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:47 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da Sep 25 16:12:47 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:47 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7db88564-8722-446c-9a91-73faa45887da" returned: 0 in 0.495s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "cinder-quobyte-7db88564-8722-446c-9a91-73faa45887da" released by "delete_volume" :: held 1.348s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Flow 'volume_create_manager' (9d8b4c74-facf-4b6d-b343-0a11f4b64b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089e011f-25e7-4887-8040-4ef492f5102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089e011f-25e7-4887-8040-4ef492f5102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-984621795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdd065e-3d99-4e2b-baf1-a7b13e952034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279f5bd32bd649c5b1b489ee06ba2292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:48Z,use_quota=True,user_id='200d850a5fec4d2a9246b21eee6beb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a9869-3936-4ad6-9e71-923bf5880f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a9869-3936-4ad6-9e71-923bf5880f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbb5497-ed0d-4422-b73a-f513e4189dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:47 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Created reservations ['538afbf7-a6a2-4262-82fd-2c2104bd57cb', '7e54a5d4-0a0a-4898-869a-13890c91f671', 'c3f013be-0076-4150-8072-9c8fa2cac46a', '9df318dc-d518-432b-8511-01207b207250'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:48 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:12:48 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbb5497-ed0d-4422-b73a-f513e4189dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'volume_name': 'volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde4a199-bb25-44d7-a7c5-58441ccee1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde4a199-bb25-44d7-a7c5-58441ccee1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f07912-cbec-4432-96d6-9243e69ad496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:48 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Volume dcdd065e-3d99-4e2b-baf1-a7b13e952034: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Trying to clone dcdd065e-3d99-4e2b-baf1-a7b13e952034 from image a5d467e0-719a-49cf-b176-4393aa2e5a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.407s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Deleted volume successfully. Sep 25 16:12:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e4827b4f-42c9-4aad-8ee5-a74c4d4f2813 tempest-VolumesServicesTestJSON-949728934 None] Lock "cinder-7db88564-8722-446c-9a91-73faa45887da-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:49 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:12:49 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:12:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e90da8-006e-4d3a-8189-bdc74424f122]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:49 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD Sep 25 16:12:49 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:49 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:49 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d is fetched for user 200d850a5fec4d2a9246b21eee6beb97. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9dd8d-7616-47ee-8f1a-bf8fdd18f865]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD Sep 25 16:12:50 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:50 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-984621795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdd065e-3d99-4e2b-baf1-a7b13e952034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279f5bd32bd649c5b1b489ee06ba2292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:48Z,use_quota=True,user_id='200d850a5fec4d2a9246b21eee6beb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Creating volume dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:12:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1073741824 Sep 25 16:12:50 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:51 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1073741824" returned: 0 in 0.923s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:51 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 Sep 25 16:12:51 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:52 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034" returned: 0 in 0.500s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Attempting download of a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume dcdd065e-3d99-4e2b-baf1-a7b13e952034. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca6cead-9b17-461f-84ab-e22e39346988]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:52 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8 Sep 25 16:12:52 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:52 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:53 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8 Sep 25 16:12:53 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:53 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8" returned: 1 in 0.587s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_iso5tbh8' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ab49b7-a9b0-4425-8d38-5a2861a26246]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:53 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD Sep 25 16:12:53 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:53 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:53 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] a5d467e0-719a-49cf-b176-4393aa2e5a8d was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:54 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 Sep 25 16:12:54 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:56 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034" returned: 0 in 2.910s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:56 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_ciqe9ln2devstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:12:56 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Converted 112.00 MB image at 38.47 MB/s Sep 25 16:12:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:56 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1G Sep 25 16:12:56 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:57 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 1G" returned: 0 in 0.526s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Downloaded image a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume dcdd065e-3d99-4e2b-baf1-a7b13e952034 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d for user 200d850a5fec4d2a9246b21eee6beb97 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Marking volume dcdd065e-3d99-4e2b-baf1-a7b13e952034 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Copying metadata from image a5d467e0-719a-49cf-b176-4393aa2e5a8d to dcdd065e-3d99-4e2b-baf1-a7b13e952034. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Creating volume glance metadata for volume dcdd065e-3d99-4e2b-baf1-a7b13e952034 backed by image a5d467e0-719a-49cf-b176-4393aa2e5a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f07912-cbec-4432-96d6-9243e69ad496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939617ba-90ad-4ad1-a56f-6f3462df790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Volume volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 (dcdd065e-3d99-4e2b-baf1-a7b13e952034): created successfully Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939617ba-90ad-4ad1-a56f-6f3462df790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Flow 'volume_create_manager' (9d8b4c74-facf-4b6d-b343-0a11f4b64b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-af38c62b-0e42-48dc-8622-ff87c0fc1962 tempest-TestShelveInstance-2095574407 None] Created volume successfully. Sep 25 16:13:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-406dc699-328d-407f-9af9-5dc3ba3b2f27 req-aa060988-ca37-4cde-bc86-5084f0ca2751 tempest-AttachVolumeTestJSON-602691155 None] Terminate volume connection completed successfully. Sep 25 16:13:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-406dc699-328d-407f-9af9-5dc3ba3b2f27 req-aa060988-ca37-4cde-bc86-5084f0ca2751 tempest-AttachVolumeTestJSON-602691155 None] Deleting attachment b83dc3d3-fb11-4515-a6cc-47d684f5df5d. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:13:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-c9925655-3fbf-4f44-9892-607c7dffcef5 req-fce76c0c-f3da-4152-bc4d-63e0d948d622 tempest-TestShelveInstance-2095574407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-c9925655-3fbf-4f44-9892-607c7dffcef5 req-fce76c0c-f3da-4152-bc4d-63e0d948d622 tempest-TestShelveInstance-2095574407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-c9925655-3fbf-4f44-9892-607c7dffcef5 req-fce76c0c-f3da-4152-bc4d-63e0d948d622 tempest-TestShelveInstance-2095574407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-c9925655-3fbf-4f44-9892-607c7dffcef5 req-fce76c0c-f3da-4152-bc4d-63e0d948d622 tempest-TestShelveInstance-2095574407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f077bae-8da2-4459-ba51-48c51abcc3d8', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:13:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-c9925655-3fbf-4f44-9892-607c7dffcef5 req-fce76c0c-f3da-4152-bc4d-63e0d948d622 tempest-TestShelveInstance-2095574407 None] attachment_update completed successfully. Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:06 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:13:06 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:06 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Flow 'volume_create_manager' (57421ebf-b096-497e-90be-7c067a21bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9560656-8b5a-410a-b348-09358f188ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9560656-8b5a-410a-b348-09358f188ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582331497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1165052-c890-4780-884d-7ef1bbd1de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e684b316c6743678da6e10bfb067025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:09Z,use_quota=True,user_id='71bb8a9c9f9f42aaa6b880f19fc5ae20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4431b2f6-5872-4075-a3f3-1bf76eba75a8),volume_type_id=4431b2f6-5872-4075-a3f3-1bf76eba75a8)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e308a08-4e51-4dac-a30f-61697f41d0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e308a08-4e51-4dac-a30f-61697f41d0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81eeb06-d6ae-440c-a5ae-4e8701748ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81eeb06-d6ae-440c-a5ae-4e8701748ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1165052-c890-4780-884d-7ef1bbd1de58', 'volume_name': 'volume-f1165052-c890-4780-884d-7ef1bbd1de58', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f14bd-fd65-48db-b222-439164c11300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f14bd-fd65-48db-b222-439164c11300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe555342-a95c-49ee-99a4-63bf1ccfbf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Volume f1165052-c890-4780-884d-7ef1bbd1de58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1165052-c890-4780-884d-7ef1bbd1de58', 'volume_size': 1} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582331497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1165052-c890-4780-884d-7ef1bbd1de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e684b316c6743678da6e10bfb067025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:09Z,use_quota=True,user_id='71bb8a9c9f9f42aaa6b880f19fc5ae20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4431b2f6-5872-4075-a3f3-1bf76eba75a8),volume_type_id=4431b2f6-5872-4075-a3f3-1bf76eba75a8)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Creating volume f1165052-c890-4780-884d-7ef1bbd1de58 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:09 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 1073741824 Sep 25 16:13:09 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:10 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 1073741824" returned: 0 in 0.790s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:10 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 Sep 25 16:13:10 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:10 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58" returned: 0 in 0.474s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe555342-a95c-49ee-99a4-63bf1ccfbf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1165052-c890-4780-884d-7ef1bbd1de58', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb7fbbb-776d-416d-8fc8-1f2bccff3698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Volume volume-f1165052-c890-4780-884d-7ef1bbd1de58 (f1165052-c890-4780-884d-7ef1bbd1de58): created successfully Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb7fbbb-776d-416d-8fc8-1f2bccff3698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Flow 'volume_create_manager' (57421ebf-b096-497e-90be-7c067a21bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-755a9bd5-d604-4039-87b7-773fb5594500 tempest-VolumeTypesAccessTest-1799861773 None] Created volume successfully. Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Acquiring lock "cinder-f1165052-c890-4780-884d-7ef1bbd1de58-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "cinder-f1165052-c890-4780-884d-7ef1bbd1de58-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Acquiring lock "cinder-quobyte-f1165052-c890-4780-884d-7ef1bbd1de58" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "cinder-quobyte-f1165052-c890-4780-884d-7ef1bbd1de58" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6da06aa-6985-4e8a-a5e1-475f8279051a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:11 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 Sep 25 16:13:11 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:12 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58" returned: 0 in 0.861s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:12 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58 Sep 25 16:13:12 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:13 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f1165052-c890-4780-884d-7ef1bbd1de58" returned: 0 in 0.965s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "cinder-quobyte-f1165052-c890-4780-884d-7ef1bbd1de58" released by "delete_volume" :: held 1.923s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:13 devstack cinder-volume[87199]: WARNING cinder.quota [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-841895785 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-841895785, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:13:13 devstack cinder-volume[87199]: WARNING cinder.quota [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-841895785 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-841895785, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Created reservations ['06409e7f-41d0-4f76-942d-a3255af09891', 'b1873323-ef97-4409-aaad-7b2ff60d3500', '84c1cafb-2b85-4aef-9ab1-5a018e7f34d6', 'f19ad37e-a0e5-428e-abf8-5aa05d22ffcc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:13 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:13:13 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:14 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.586s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Deleted volume successfully. Sep 25 16:13:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82768709-ba36-4c73-8494-072b969256f2 tempest-VolumeTypesAccessTest-1799861773 None] Lock "cinder-f1165052-c890-4780-884d-7ef1bbd1de58-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:23 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-228c9e8d-578f-4230-89b0-a3821bf9ad52 req-46249e65-4301-4e5d-804e-c6d58e52ab62 tempest-AttachVolumeNegativeTest-1036418157 None] Terminate volume connection completed successfully. Sep 25 16:13:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-228c9e8d-578f-4230-89b0-a3821bf9ad52 req-46249e65-4301-4e5d-804e-c6d58e52ab62 tempest-AttachVolumeNegativeTest-1036418157 None] Deleting attachment 8fd46adc-3d4b-4d23-b5b6-2eb549665053. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:13:34 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:36 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:39 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Flow 'volume_create_manager' (06b10e92-fac8-4670-99d7-da88b3373b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71e4802-78ef-4de1-bf8c-4ad17aa09685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71e4802-78ef-4de1-bf8c-4ad17aa09685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1756564608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b0a459-1277-4e2a-a29a-7463643cc2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac12a95756ee4010aec67483f849e709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:40Z,use_quota=True,user_id='4c03849601804ddf86599e311b2126a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a0f7ab-67bb-4a8a-94a2-a4c788f4d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a0f7ab-67bb-4a8a-94a2-a4c788f4d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a12908-f84a-4415-a53e-9fd41ee70019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a12908-f84a-4415-a53e-9fd41ee70019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0b0a459-1277-4e2a-a29a-7463643cc2bc', 'volume_name': 'volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121dc7e-9611-4258-987b-d65a7ba06c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121dc7e-9611-4258-987b-d65a7ba06c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfae61-4d89-431f-8219-fce27b151ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Volume a0b0a459-1277-4e2a-a29a-7463643cc2bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Trying to clone a0b0a459-1277-4e2a-a29a-7463643cc2bc from image a5d467e0-719a-49cf-b176-4393aa2e5a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:13:40 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af5cef-fe25-458d-8467-b78596790a58]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:41 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD Sep 25 16:13:41 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:41 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d is fetched for user 4c03849601804ddf86599e311b2126a9. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ce9db-7f8b-4f99-8a3d-99127148edd6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:41 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD Sep 25 16:13:41 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:41 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1756564608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b0a459-1277-4e2a-a29a-7463643cc2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac12a95756ee4010aec67483f849e709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:40Z,use_quota=True,user_id='4c03849601804ddf86599e311b2126a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Creating volume a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:13:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:41 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1073741824 Sep 25 16:13:41 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:42 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1073741824" returned: 0 in 0.723s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:42 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc Sep 25 16:13:42 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:42 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc" returned: 0 in 0.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Attempting download of a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume a0b0a459-1277-4e2a-a29a-7463643cc2bc. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609f615-4fb4-4e87-a3d4-cfdda4bb13cd]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw Sep 25 16:13:43 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw Sep 25 16:13:43 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw" returned: 1 in 0.431s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_9nmkzpfw' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290e66d-6fca-4e7b-8654-469307aee8c4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:44 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD Sep 25 16:13:44 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:44 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:44 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] a5d467e0-719a-49cf-b176-4393aa2e5a8d was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:13:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:44 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc Sep 25 16:13:44 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc" returned: 0 in 3.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_tf274dtsdevstack@QuobyteHD, size 112.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:48 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Converted 112.00 MB image at 34.05 MB/s Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:48 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1G Sep 25 16:13:48 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc 1G" returned: 0 in 0.476s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Downloaded image a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume a0b0a459-1277-4e2a-a29a-7463643cc2bc successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d for user 4c03849601804ddf86599e311b2126a9 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Marking volume a0b0a459-1277-4e2a-a29a-7463643cc2bc as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Copying metadata from image a5d467e0-719a-49cf-b176-4393aa2e5a8d to a0b0a459-1277-4e2a-a29a-7463643cc2bc. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:13:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Creating volume glance metadata for volume a0b0a459-1277-4e2a-a29a-7463643cc2bc backed by image a5d467e0-719a-49cf-b176-4393aa2e5a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:13:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfae61-4d89-431f-8219-fce27b151ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4906767-5fb0-4b5b-8ec8-f3f644245885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Volume volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc (a0b0a459-1277-4e2a-a29a-7463643cc2bc): created successfully Sep 25 16:13:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4906767-5fb0-4b5b-8ec8-f3f644245885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Flow 'volume_create_manager' (06b10e92-fac8-4670-99d7-da88b3373b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-14cd825a-9452-4b97-bd21-0707b247a23c tempest-VolumesImageMetadata-178217009 None] Created volume successfully. Sep 25 16:13:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-f4953d57-5fb9-406e-9003-dbe6d1e0e5c3 req-45c14269-8888-47fe-9649-4748a23c38a0 tempest-TestShelveInstance-2095574407 None] Terminate volume connection completed successfully. Sep 25 16:13:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-f4953d57-5fb9-406e-9003-dbe6d1e0e5c3 req-45c14269-8888-47fe-9649-4748a23c38a0 tempest-TestShelveInstance-2095574407 None] Deleting attachment 8f077bae-8da2-4459-ba51-48c51abcc3d8. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Acquiring lock "cinder-a0b0a459-1277-4e2a-a29a-7463643cc2bc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "cinder-a0b0a459-1277-4e2a-a29a-7463643cc2bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Acquiring lock "cinder-quobyte-a0b0a459-1277-4e2a-a29a-7463643cc2bc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "cinder-quobyte-a0b0a459-1277-4e2a-a29a-7463643cc2bc" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247b51c-40e7-4f0f-83f8-c9f8881d4543]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:51 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc Sep 25 16:13:51 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:52 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc" returned: 0 in 0.652s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:52 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc Sep 25 16:13:52 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:52 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0b0a459-1277-4e2a-a29a-7463643cc2bc" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "cinder-quobyte-a0b0a459-1277-4e2a-a29a-7463643cc2bc" released by "delete_volume" :: held 1.560s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Created reservations ['e8caa075-19d6-4d8f-b72e-ae9a4cedaac4', '15447d93-381b-4683-9c73-2dff00809222', '5219e61c-dd19-407b-a71c-5feedf7fd447', 'c46f85af-8d9c-4893-9bc6-85944002f6af'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:53 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:13:53 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:53 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.551s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Deleted volume successfully. Sep 25 16:13:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-27e0a72b-b4ef-41d6-b842-173d6136d449 tempest-VolumesImageMetadata-178217009 None] Lock "cinder-a0b0a459-1277-4e2a-a29a-7463643cc2bc-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2780112b-059c-4ecc-ae6a-9e165a883278 req-e483a215-066f-4c19-9351-6e8e1fe79d9d tempest-TestShelveInstance-2095574407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2780112b-059c-4ecc-ae6a-9e165a883278 req-e483a215-066f-4c19-9351-6e8e1fe79d9d tempest-TestShelveInstance-2095574407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2780112b-059c-4ecc-ae6a-9e165a883278 req-e483a215-066f-4c19-9351-6e8e1fe79d9d tempest-TestShelveInstance-2095574407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2780112b-059c-4ecc-ae6a-9e165a883278 req-e483a215-066f-4c19-9351-6e8e1fe79d9d tempest-TestShelveInstance-2095574407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22527833-ba95-40f1-866a-f8fb8a78096d', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:13:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-2780112b-059c-4ecc-ae6a-9e165a883278 req-e483a215-066f-4c19-9351-6e8e1fe79d9d tempest-TestShelveInstance-2095574407 None] attachment_update completed successfully. Sep 25 16:14:00 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Flow 'volume_create_manager' (e72d6e54-36e7-4e5f-a070-e8aef17f3ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd7a79a-34dc-4f04-b44d-087175973762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd7a79a-34dc-4f04-b44d-087175973762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1369871084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0da5418-32ca-42b5-a996-27b4504fd629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5fe2beaa1c4fecb61d1e0fe0f709ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:01Z,use_quota=True,user_id='2e05db8ddb8a4f4681da4ab135e0d5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf17c57-f25a-416c-a4a3-758df6ce739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf17c57-f25a-416c-a4a3-758df6ce739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346eb28-6f0a-419f-af0b-cd6c1f570b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346eb28-6f0a-419f-af0b-cd6c1f570b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0da5418-32ca-42b5-a996-27b4504fd629', 'volume_name': 'volume-a0da5418-32ca-42b5-a996-27b4504fd629', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da13b91f-531d-4dea-8a39-6fad88746bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da13b91f-531d-4dea-8a39-6fad88746bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f143eb-844d-4388-8b5d-2dc08752130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Volume a0da5418-32ca-42b5-a996-27b4504fd629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0da5418-32ca-42b5-a996-27b4504fd629', 'volume_size': 1} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1369871084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0da5418-32ca-42b5-a996-27b4504fd629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5fe2beaa1c4fecb61d1e0fe0f709ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:01Z,use_quota=True,user_id='2e05db8ddb8a4f4681da4ab135e0d5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Creating volume a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:01 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:14:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:01 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 1073741824 Sep 25 16:14:01 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:02 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 1073741824" returned: 0 in 1.016s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:02 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 Sep 25 16:14:02 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:02 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629" returned: 0 in 0.353s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f143eb-844d-4388-8b5d-2dc08752130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0da5418-32ca-42b5-a996-27b4504fd629', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7992ce3-c3c0-4613-8114-598f3063ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Volume volume-a0da5418-32ca-42b5-a996-27b4504fd629 (a0da5418-32ca-42b5-a996-27b4504fd629): created successfully Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7992ce3-c3c0-4613-8114-598f3063ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Flow 'volume_create_manager' (e72d6e54-36e7-4e5f-a070-e8aef17f3ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f42398b8-6857-4f51-b28d-943d5b848321 tempest-SnapshotMetadataTestJSON-1909927830 None] Created volume successfully. Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Creating offline snapshot e16db14c-1627-4505-80e9-0da891208f1c of volume a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[724909f5-095b-493c-9462-20259fe5f9ff]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:03 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 Sep 25 16:14:03 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629" returned: 0 in 0.540s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:03 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c 1G Sep 25 16:14:03 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:04 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c 1G" returned: 0 in 0.571s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0da5418-32ca-42b5-a996-27b4504fd629 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:04 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0da5418-32ca-42b5-a996-27b4504fd629 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c Sep 25 16:14:04 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:04 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0da5418-32ca-42b5-a996-27b4504fd629 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c" returned: 0 in 0.563s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:04 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c is being set with open permissions: ugo+rw Sep 25 16:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:04 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c Sep 25 16:14:04 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:05 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c" returned: 0 in 0.347s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:05 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info Sep 25 16:14:05 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:05 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:05 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info is being set with open permissions: ugo+rw Sep 25 16:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:05 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info Sep 25 16:14:05 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:06 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.info" returned: 0 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:06 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:14:06 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c60df091-8d4a-43b3-8ddd-011d564c6eec tempest-SnapshotMetadataTestJSON-1909927830 None] Create snapshot completed successfully Sep 25 16:14:06 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.584s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:14:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "cinder-e16db14c-1627-4505-80e9-0da891208f1c-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-e16db14c-1627-4505-80e9-0da891208f1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "cinder-quobyte-e16db14c-1627-4505-80e9-0da891208f1c" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-e16db14c-1627-4505-80e9-0da891208f1c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Deleting offline snapshot e16db14c-1627-4505-80e9-0da891208f1c of volume a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] snapshot_file for this snap is: volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:14:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0e2909-e41e-4320-804c-f47a5d5239f6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:08 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c Sep 25 16:14:08 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:08 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c" returned: 0 in 0.877s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0da5418-32ca-42b5-a996-27b4504fd629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[131719fe-3ed5-49ea-8a87-70385928ff88]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:09 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 Sep 25 16:14:09 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:10 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629" returned: 0 in 1.179s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:10 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c Sep 25 16:14:10 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:10 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:10 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c Sep 25 16:14:10 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:11 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629.e16db14c-1627-4505-80e9-0da891208f1c" returned: 0 in 0.426s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-e16db14c-1627-4505-80e9-0da891208f1c" released by "_delete_snapshot" :: held 3.445s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" released by "delete_snapshot" :: held 3.484s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:11 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Created reservations ['ef85d395-7aeb-4764-beb1-0ee28818eda0', '413da6c2-3cd5-420d-9fde-1af28d68abc3', '84a488ca-b641-40be-a5cf-d08ef00e656c', 'ebcc9c02-949a-433d-b081-594f3cf361a3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Delete snapshot completed successfully. Sep 25 16:14:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5a20a7f-a1ba-4995-96ca-c33bf6e16bd3 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-e16db14c-1627-4505-80e9-0da891208f1c-delete_snapshot" released by "delete_snapshot" :: held 3.742s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "cinder-a0da5418-32ca-42b5-a996-27b4504fd629-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-a0da5418-32ca-42b5-a996-27b4504fd629-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ebb126-ba1c-448c-a0f0-ee3a5d44a24d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (54bd5f99-894a-4c7e-b561-82a69828428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df60a489-ff06-49b0-9ab3-368fe8b58417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:13 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 Sep 25 16:14:13 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df60a489-ff06-49b0-9ab3-368fe8b58417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-33499518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee975f9-eb53-4696-b849-fd1a2cba7449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:13Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07341f2-a613-494b-ae77-1622a2e2f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07341f2-a613-494b-ae77-1622a2e2f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee96f1d1-972b-4685-b000-bc70b48adbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee96f1d1-972b-4685-b000-bc70b48adbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee975f9-eb53-4696-b849-fd1a2cba7449', 'volume_name': 'volume-fee975f9-eb53-4696-b849-fd1a2cba7449', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433bbe9a-1917-4346-a28e-bed0efb96f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433bbe9a-1917-4346-a28e-bed0efb96f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd00deb8-76a2-4b4f-90b6-e41ed7582ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Volume fee975f9-eb53-4696-b849-fd1a2cba7449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee975f9-eb53-4696-b849-fd1a2cba7449', 'volume_size': 1} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-33499518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee975f9-eb53-4696-b849-fd1a2cba7449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:13Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Creating volume fee975f9-eb53-4696-b849-fd1a2cba7449 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:14:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:13 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 1073741824 Sep 25 16:14:13 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:14 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629" returned: 0 in 1.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:14 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629 Sep 25 16:14:14 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:14 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a0da5418-32ca-42b5-a996-27b4504fd629" returned: 0 in 0.484s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:14 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 1073741824" returned: 0 in 1.196s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-quobyte-a0da5418-32ca-42b5-a996-27b4504fd629" released by "delete_volume" :: held 1.963s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:14 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 Sep 25 16:14:14 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Created reservations ['140d297b-08cd-496d-80aa-9bc138d52983', '91490813-ace6-4384-9cc3-a59d245474e7', '5f03cf45-b800-4079-b510-108f629ac32d', 'aafc30f3-7e5f-4bf0-90bc-7ae5d5a7dbfc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:15 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:14:15 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:15 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449" returned: 0 in 0.671s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd00deb8-76a2-4b4f-90b6-e41ed7582ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee975f9-eb53-4696-b849-fd1a2cba7449', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72db71-cfb2-4c87-ac20-57837ef8b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Volume volume-fee975f9-eb53-4696-b849-fd1a2cba7449 (fee975f9-eb53-4696-b849-fd1a2cba7449): created successfully Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72db71-cfb2-4c87-ac20-57837ef8b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (54bd5f99-894a-4c7e-b561-82a69828428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-efccead9-ee30-486f-8da9-516bd9c2b422 tempest-AttachVolumeNegativeTest-1036418157 None] Created volume successfully. Sep 25 16:14:15 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.587s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Deleted volume successfully. Sep 25 16:14:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8c4569bc-04a4-4f1c-a77f-1bbc636643b8 tempest-SnapshotMetadataTestJSON-1909927830 None] Lock "cinder-a0da5418-32ca-42b5-a996-27b4504fd629-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5f60153e-25f3-4dd0-8c4d-54b42cf7ff7f req-1dd98dd7-8015-45ea-ad3a-6922e12829c4 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5f60153e-25f3-4dd0-8c4d-54b42cf7ff7f req-1dd98dd7-8015-45ea-ad3a-6922e12829c4 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5f60153e-25f3-4dd0-8c4d-54b42cf7ff7f req-1dd98dd7-8015-45ea-ad3a-6922e12829c4 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5f60153e-25f3-4dd0-8c4d-54b42cf7ff7f req-1dd98dd7-8015-45ea-ad3a-6922e12829c4 tempest-AttachVolumeNegativeTest-1036418157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-fee975f9-eb53-4696-b849-fd1a2cba7449', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cff23dd-77ac-4dc6-bad0-d9c2ec192013', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:14:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5f60153e-25f3-4dd0-8c4d-54b42cf7ff7f req-1dd98dd7-8015-45ea-ad3a-6922e12829c4 tempest-AttachVolumeNegativeTest-1036418157 None] attachment_update completed successfully. Sep 25 16:14:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7218e3b3-60f5-4b8d-8bd8-6892315da460 req-7e8b3474-7546-4c8f-bca1-b50a4a0d700d tempest-AttachVolumeNegativeTest-1036418157 None] Terminate volume connection completed successfully. Sep 25 16:14:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-7218e3b3-60f5-4b8d-8bd8-6892315da460 req-7e8b3474-7546-4c8f-bca1-b50a4a0d700d tempest-AttachVolumeNegativeTest-1036418157 None] Deleting attachment 3cff23dd-77ac-4dc6-bad0-d9c2ec192013. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Flow 'volume_create_manager' (8a6b1bcb-2ca3-4461-9ced-a39ca0dcc242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13aeefcf-f7ee-4af2-9568-24c93e7b0423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13aeefcf-f7ee-4af2-9568-24c93e7b0423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-490039173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4134dd-f217-4cd3-b6f2-dae5fd2482b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be17690bc454098b21a6e949199599d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:24Z,use_quota=True,user_id='1b8095fefe5a4dd1a2c5075bf92c4d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b77f90-672a-445f-992e-b565e203ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b77f90-672a-445f-992e-b565e203ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18afeeb-e5bd-44ea-a627-387d406b6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18afeeb-e5bd-44ea-a627-387d406b6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4134dd-f217-4cd3-b6f2-dae5fd2482b3', 'volume_name': 'volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680e613f-9279-4ffb-b7ea-b7392d4cd748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680e613f-9279-4ffb-b7ea-b7392d4cd748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7b5ba2-3363-4f5b-8a6e-90a53b087f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Volume 5a4134dd-f217-4cd3-b6f2-dae5fd2482b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3', 'volume_size': 1} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-490039173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4134dd-f217-4cd3-b6f2-dae5fd2482b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be17690bc454098b21a6e949199599d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:24Z,use_quota=True,user_id='1b8095fefe5a4dd1a2c5075bf92c4d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Creating volume 5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:23 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:14:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:23 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 1073741824 Sep 25 16:14:23 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:24 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 1073741824" returned: 0 in 1.054s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:25 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 Sep 25 16:14:25 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:25 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" returned: 0 in 0.423s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7b5ba2-3363-4f5b-8a6e-90a53b087f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8242c8-707b-43c2-bd7b-efee26b50744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Volume volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 (5a4134dd-f217-4cd3-b6f2-dae5fd2482b3): created successfully Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8242c8-707b-43c2-bd7b-efee26b50744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Flow 'volume_create_manager' (8a6b1bcb-2ca3-4461-9ced-a39ca0dcc242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cfd56ede-fbe4-4405-85c6-f8d6524e35e2 tempest-VolumesMetadataTest-411684458 None] Created volume successfully. Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Acquiring lock "cinder-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "cinder-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Acquiring lock "cinder-quobyte-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "cinder-quobyte-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adaf27-be70-4d0e-986f-114f44fd924b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:27 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 Sep 25 16:14:27 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:28 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" returned: 0 in 0.636s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:28 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3 Sep 25 16:14:28 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:28 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" returned: 0 in 0.518s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "cinder-quobyte-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3" released by "delete_volume" :: held 1.236s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Created reservations ['d5c70127-90a6-4ac2-824f-3378ed099b18', '6daf73a4-8969-492d-afcd-ad4196317720', '77fad64f-5d35-4a79-99ab-76e7f65da44d', 'a99206a2-1ec0-47a3-9e66-9438e6c2f3cc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:29 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:14:29 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:29 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Deleted volume successfully. Sep 25 16:14:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f2d527a-ae0e-4222-acda-30195e736742 tempest-VolumesMetadataTest-411684458 None] Lock "cinder-5a4134dd-f217-4cd3-b6f2-dae5fd2482b3-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=52,cinder:INSERT=14,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Flow 'volume_create_manager' (05cee9a3-ffce-4350-a8f5-6ebf8ed4acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f169a-5c91-4646-ab24-c18174299d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f169a-5c91-4646-ab24-c18174299d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-733990646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded2854b-889c-457c-a6d6-ef7a7224a469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f8cb8b4ab943a3a7f5db48c567128b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:36Z,use_quota=True,user_id='10a081a352d04b0f8693322558d862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e30bea-d3b2-4237-821f-3d4b9fe96ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e30bea-d3b2-4237-821f-3d4b9fe96ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c71b866-9bfd-4186-b529-e2d880365241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c71b866-9bfd-4186-b529-e2d880365241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded2854b-889c-457c-a6d6-ef7a7224a469', 'volume_name': 'volume-ded2854b-889c-457c-a6d6-ef7a7224a469', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2723a4-cda8-4113-ae71-d9f8bb945cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2723a4-cda8-4113-ae71-d9f8bb945cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30cb5d-0ef0-4034-ba67-4b0d6b287ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Volume ded2854b-889c-457c-a6d6-ef7a7224a469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded2854b-889c-457c-a6d6-ef7a7224a469', 'volume_size': 1} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-733990646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded2854b-889c-457c-a6d6-ef7a7224a469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f8cb8b4ab943a3a7f5db48c567128b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:36Z,use_quota=True,user_id='10a081a352d04b0f8693322558d862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Creating volume ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:36 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 1073741824 Sep 25 16:14:36 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:36 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 1073741824" returned: 0 in 0.564s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=60,cinder:UPDATE=51,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:36 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:14:36 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:37 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.406s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30cb5d-0ef0-4034-ba67-4b0d6b287ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded2854b-889c-457c-a6d6-ef7a7224a469', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f353f069-fb37-467a-978c-81a66024e0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Volume volume-ded2854b-889c-457c-a6d6-ef7a7224a469 (ded2854b-889c-457c-a6d6-ef7a7224a469): created successfully Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f353f069-fb37-467a-978c-81a66024e0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Flow 'volume_create_manager' (05cee9a3-ffce-4350-a8f5-6ebf8ed4acbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-96aaa895-4e20-4bd3-ae0d-533093538fae tempest-VolumesCloneTest-1950219886 None] Created volume successfully. Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Flow 'volume_create_manager' (50130f7c-7c5d-49d9-bc47-e7551627b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392f90ab-24f6-471f-bd21-5b34d0fb7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392f90ab-24f6-471f-bd21-5b34d0fb7da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-596131799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5781a397-49be-41bf-8360-57f7d013119b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f8cb8b4ab943a3a7f5db48c567128b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ded2854b-889c-457c-a6d6-ef7a7224a469,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:39Z,use_quota=True,user_id='10a081a352d04b0f8693322558d862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790bdd5d-ee4c-426d-8fb3-fc187a62d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790bdd5d-ee4c-426d-8fb3-fc187a62d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce7e02c-1ab2-414f-a1aa-088de8067a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce7e02c-1ab2-414f-a1aa-088de8067a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5781a397-49be-41bf-8360-57f7d013119b', 'volume_name': 'volume-5781a397-49be-41bf-8360-57f7d013119b', 'volume_size': 2, 'source_volid': 'ded2854b-889c-457c-a6d6-ef7a7224a469', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03142ecc-b6e7-4fbc-8c9d-a6587e8cda2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03142ecc-b6e7-4fbc-8c9d-a6587e8cda2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf0bf1b-eb4f-4238-b212-e1a4b3e5f5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Volume 5781a397-49be-41bf-8360-57f7d013119b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5781a397-49be-41bf-8360-57f7d013119b', 'volume_size': 2, 'source_volid': 'ded2854b-889c-457c-a6d6-ef7a7224a469', 'source_volstatus': 'available'} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Cloning volume ded2854b-889c-457c-a6d6-ef7a7224a469 to volume 5781a397-49be-41bf-8360-57f7d013119b Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Creating offline snapshot 635313ab-29e2-4e5c-9c50-b9907262956a of volume ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f00eca-1985-4c45-93c5-e3cd7a6fdad1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:38 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:14:38 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:39 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.502s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:39 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a 1G Sep 25 16:14:39 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:39 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a 1G" returned: 0 in 0.647s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded2854b-889c-457c-a6d6-ef7a7224a469 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:40 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded2854b-889c-457c-a6d6-ef7a7224a469 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:40 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:40 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded2854b-889c-457c-a6d6-ef7a7224a469 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:40 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a is being set with open permissions: ugo+rw Sep 25 16:14:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:40 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:40 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:40 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.412s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:40 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info Sep 25 16:14:40 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:41 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info" returned: 0 in 0.648s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:41 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info is being set with open permissions: ugo+rw Sep 25 16:14:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:41 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info Sep 25 16:14:41 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:41 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.info" returned: 0 in 0.460s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] snapshot: 635313ab-29e2-4e5c-9c50-b9907262956a, volume: 5781a397-49be-41bf-8360-57f7d013119b, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f3ff4e-5878-4713-9d4b-635f6f90d38d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:42 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:42 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:42 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.594s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded2854b-889c-457c-a6d6-ef7a7224a469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[32672fa3-e342-4e24-a940-767e356ce620]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:42 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:14:42 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:43 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:14:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:14:43 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:14:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:43 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b Sep 25 16:14:43 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (dec525f2-afdb-43f4-9b71-5d8ce69573ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57cb71f-2fcd-4f5f-b4b0-124ba74eca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57cb71f-2fcd-4f5f-b4b0-124ba74eca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-587096179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4326e0fe-8aad-43fe-90de-48793bc6dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:47Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08bcbd1-1a0b-4935-adfa-854466a69adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08bcbd1-1a0b-4935-adfa-854466a69adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5f38ab-dc2d-4b17-9e79-57d2fc791025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5f38ab-dc2d-4b17-9e79-57d2fc791025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4326e0fe-8aad-43fe-90de-48793bc6dcaa', 'volume_name': 'volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ffd92d-d3f8-47e8-865d-70f5ef811b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ffd92d-d3f8-47e8-865d-70f5ef811b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78aeeee9-52e8-40fc-8271-b0699503ac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Volume 4326e0fe-8aad-43fe-90de-48793bc6dcaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa', 'volume_size': 1} Sep 25 16:14:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-51101b79-5c40-46ba-8b1a-6ab1a080c486 tempest-TestShelveInstance-2095574407 None] Terminate volume connection completed successfully. Sep 25 16:14:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-51101b79-5c40-46ba-8b1a-6ab1a080c486 tempest-TestShelveInstance-2095574407 None] Deleting attachment 22527833-ba95-40f1-866a-f8fb8a78096d. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:14:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Acquiring lock "cinder-dcdd065e-3d99-4e2b-baf1-a7b13e952034-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "cinder-dcdd065e-3d99-4e2b-baf1-a7b13e952034-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Acquiring lock "cinder-quobyte-dcdd065e-3d99-4e2b-baf1-a7b13e952034" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "cinder-quobyte-dcdd065e-3d99-4e2b-baf1-a7b13e952034" acquired by "delete_volume" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[60492476-8cc8-4c57-a6f9-f8aaf36a6f46]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:51 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 Sep 25 16:14:51 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:52 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034" returned: 0 in 1.425s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:52 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034 Sep 25 16:14:52 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:53 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-dcdd065e-3d99-4e2b-baf1-a7b13e952034" returned: 0 in 1.057s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "cinder-quobyte-dcdd065e-3d99-4e2b-baf1-a7b13e952034" released by "delete_volume" :: held 2.663s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG cinder.quota [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Created reservations ['38a807bb-164a-4a37-96e4-54e0a797530d', '854faef0-110d-4fa1-837c-3036f449c30d', '75ff86f6-fc19-42a6-b0e0-3d2b5d69be95', '79a4483b-543f-42b1-9f2d-0ed3afe0e0e7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:54 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:14:54 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:54 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:54 devstack cinder-volume[87199]: DEBUG cinder.manager [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Deleted volume successfully. Sep 25 16:14:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3903ab7-4442-417b-a578-eadefbe94d90 req-6cfc0c06-204e-4e9d-b3f5-8275c1fa0946 tempest-TestShelveInstance-2095574407 None] Lock "cinder-dcdd065e-3d99-4e2b-baf1-a7b13e952034-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:57 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b" returned: 0 in 13.815s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469, size 1024.00 MB, duration 13.82 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:14:57 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Converted 1024.00 MB image at 74.11 MB/s Sep 25 16:14:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b is being set with open permissions: ugo+rw Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:57 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b Sep 25 16:14:57 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:57 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b" returned: 0 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" released by "_copy_volume_from_snapshot" :: held 15.635s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-quobyte-635313ab-29e2-4e5c-9c50-b9907262956a" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-635313ab-29e2-4e5c-9c50-b9907262956a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Deleting offline snapshot 635313ab-29e2-4e5c-9c50-b9907262956a of volume ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] snapshot_file for this snap is: volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70531790-37e8-49c5-9167-45ee4acf5cf3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:57 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:57 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:58 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.571s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded2854b-889c-457c-a6d6-ef7a7224a469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adf605b-587d-4512-a41e-8d8ff36dcc7f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:58 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:14:58 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:59 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:59 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.572s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:59 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a Sep 25 16:14:59 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469.635313ab-29e2-4e5c-9c50-b9907262956a" returned: 0 in 0.296s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-635313ab-29e2-4e5c-9c50-b9907262956a" released by "_delete_snapshot" :: held 2.255s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.233s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.158s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-587096179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4326e0fe-8aad-43fe-90de-48793bc6dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:47Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Creating volume 4326e0fe-8aad-43fe-90de-48793bc6dcaa {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:00 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa 1073741824 Sep 25 16:15:00 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf0bf1b-eb4f-4238-b212-e1a4b3e5f5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5781a397-49be-41bf-8360-57f7d013119b', 'volume_size': 2, 'source_volid': 'ded2854b-889c-457c-a6d6-ef7a7224a469', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0c6a7a-ab23-41db-85d1-f27916c900c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Volume volume-5781a397-49be-41bf-8360-57f7d013119b (5781a397-49be-41bf-8360-57f7d013119b): created successfully Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0c6a7a-ab23-41db-85d1-f27916c900c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Flow 'volume_create_manager' (50130f7c-7c5d-49d9-bc47-e7551627b778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9c20b462-2c27-4e6e-916a-07afcd795364 tempest-VolumesCloneTest-1950219886 None] Created volume successfully. Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-5781a397-49be-41bf-8360-57f7d013119b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "cinder-5781a397-49be-41bf-8360-57f7d013119b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:00 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa 1073741824" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d482d9-e537-4e10-8ee6-8a6dacd8106c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa Sep 25 16:15:00 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b Sep 25 16:15:00 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:01 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78aeeee9-52e8-40fc-8271-b0699503ac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefd8420-56b2-4953-bfee-0a7004c41e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Volume volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa (4326e0fe-8aad-43fe-90de-48793bc6dcaa): created successfully Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefd8420-56b2-4953-bfee-0a7004c41e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (dec525f2-afdb-43f4-9b71-5d8ce69573ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8bac81ec-04df-4753-96f7-67595c2ddb54 tempest-AttachVolumeTestJSON-602691155 None] Created volume successfully. Sep 25 16:15:01 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b" returned: 0 in 0.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b Sep 25 16:15:01 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:01 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5781a397-49be-41bf-8360-57f7d013119b" returned: 0 in 0.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-5781a397-49be-41bf-8360-57f7d013119b" released by "delete_volume" :: held 0.877s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Created reservations ['7dbda67c-b1fb-4eb3-a99b-a7c3998521f2', '1d2b8632-6da4-4231-bda0-9aadf3217aef', '43eec765-732f-4366-af08-1eeabd5d8c5e', '840b6317-15b1-4bff-b29f-2b02067d316f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:01 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-ded2854b-889c-457c-a6d6-ef7a7224a469-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-ded2854b-889c-457c-a6d6-ef7a7224a469-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "cinder-quobyte-ded2854b-889c-457c-a6d6-ef7a7224a469" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-ded2854b-889c-457c-a6d6-ef7a7224a469" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b64f34-fa38-4f8e-9e93-e3513c4ccdd7]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:02 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.578s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Deleted volume successfully. Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa91581b-7d82-4d2b-bd93-522bdbc374af tempest-VolumesCloneTest-1950219886 None] Lock "cinder-5781a397-49be-41bf-8360-57f7d013119b-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:02 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:15:02 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-afa6692e-b33d-4910-9dd6-5cb57c234aae req-136ab558-1aaa-492a-9c93-e3f1f8b0919d tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-afa6692e-b33d-4910-9dd6-5cb57c234aae req-136ab558-1aaa-492a-9c93-e3f1f8b0919d tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-afa6692e-b33d-4910-9dd6-5cb57c234aae req-136ab558-1aaa-492a-9c93-e3f1f8b0919d tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:02 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-afa6692e-b33d-4910-9dd6-5cb57c234aae req-136ab558-1aaa-492a-9c93-e3f1f8b0919d tempest-AttachVolumeTestJSON-602691155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a41dff4-5669-49ab-bbd8-ddc9b702f05d', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.614s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:02 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469 Sep 25 16:15:02 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-afa6692e-b33d-4910-9dd6-5cb57c234aae req-136ab558-1aaa-492a-9c93-e3f1f8b0919d tempest-AttachVolumeTestJSON-602691155 None] attachment_update completed successfully. Sep 25 16:15:03 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ded2854b-889c-457c-a6d6-ef7a7224a469" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-quobyte-ded2854b-889c-457c-a6d6-ef7a7224a469" released by "delete_volume" :: held 1.169s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Created reservations ['aace25d1-ea73-4ac6-9a8c-647353622664', '92465fe0-63dd-45bc-8f4b-0b7ee4436f08', '4c6c6a12-bac3-4fcc-860f-7e94c1d60c7a', '5e58a7c7-c127-4ad8-9739-529ce86ca2f8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:03 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:03 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:04 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Deleted volume successfully. Sep 25 16:15:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af298e6e-155f-42ab-89a3-06a5771c6a81 tempest-VolumesCloneTest-1950219886 None] Lock "cinder-ded2854b-889c-457c-a6d6-ef7a7224a469-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (8d896247-7284-4c8e-a3f1-b545fe2d9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96d2bcb-1b01-4f5c-8fb2-e248688f707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96d2bcb-1b01-4f5c-8fb2-e248688f707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-814193264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4f5268-f2d1-4315-882c-08809ef5e063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:06Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b07e7f-1273-49ff-8e0b-88339ba9a1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b07e7f-1273-49ff-8e0b-88339ba9a1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd19a14-20c5-4d16-81ce-f926bc4e9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd19a14-20c5-4d16-81ce-f926bc4e9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4f5268-f2d1-4315-882c-08809ef5e063', 'volume_name': 'volume-1a4f5268-f2d1-4315-882c-08809ef5e063', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8565283-e33f-4de5-9651-4024274b9e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8565283-e33f-4de5-9651-4024274b9e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514555ff-6612-4361-8564-97d252147fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Volume 1a4f5268-f2d1-4315-882c-08809ef5e063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4f5268-f2d1-4315-882c-08809ef5e063', 'volume_size': 1} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-814193264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4f5268-f2d1-4315-882c-08809ef5e063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a3c1c258f24524b3d99773c13617ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:06Z,use_quota=True,user_id='5f8f3d4eeb2444af865db6600e731fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Creating volume 1a4f5268-f2d1-4315-882c-08809ef5e063 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:05 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:05 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 1073741824 Sep 25 16:15:05 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:06 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:06 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:06 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.558s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:15:06 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 1073741824" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:06 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 Sep 25 16:15:06 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:07 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063" returned: 0 in 0.431s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514555ff-6612-4361-8564-97d252147fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4f5268-f2d1-4315-882c-08809ef5e063', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40193d6-e2de-4e16-b1a3-19185839c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Volume volume-1a4f5268-f2d1-4315-882c-08809ef5e063 (1a4f5268-f2d1-4315-882c-08809ef5e063): created successfully Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40193d6-e2de-4e16-b1a3-19185839c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Flow 'volume_create_manager' (8d896247-7284-4c8e-a3f1-b545fe2d9a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a0ca16b5-ddd9-4a8a-ab68-4e19f35a93a8 tempest-AttachVolumeTestJSON-602691155 None] Created volume successfully. Sep 25 16:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6776ed2a-a315-4abd-9e01-a66bf2145e52 req-0455ea18-2953-41e0-a4ee-27149bead085 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6776ed2a-a315-4abd-9e01-a66bf2145e52 req-0455ea18-2953-41e0-a4ee-27149bead085 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6776ed2a-a315-4abd-9e01-a66bf2145e52 req-0455ea18-2953-41e0-a4ee-27149bead085 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6776ed2a-a315-4abd-9e01-a66bf2145e52 req-0455ea18-2953-41e0-a4ee-27149bead085 tempest-AttachVolumeTestJSON-602691155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-1a4f5268-f2d1-4315-882c-08809ef5e063', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '174fe931-44b9-4cfa-9802-b82a4b8c4e33', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-6776ed2a-a315-4abd-9e01-a66bf2145e52 req-0455ea18-2953-41e0-a4ee-27149bead085 tempest-AttachVolumeTestJSON-602691155 None] attachment_update completed successfully. Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Flow 'volume_create_manager' (c7d59081-446c-4d69-89ee-f19059a4e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa836391-b779-48ec-a7e9-cf03e53c4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa836391-b779-48ec-a7e9-cf03e53c4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1071746474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa7e786-b7c5-4cd8-9140-563fea7f83c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd7676bae994824907f811a2182c415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:11Z,use_quota=True,user_id='0abf9cf7eff9458eb476cef04cdddad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5d59bf-a28b-4e08-846a-732eb0ba56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5d59bf-a28b-4e08-846a-732eb0ba56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9776b8ad-bfe5-4f98-91bc-52b858ba0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9776b8ad-bfe5-4f98-91bc-52b858ba0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa7e786-b7c5-4cd8-9140-563fea7f83c3', 'volume_name': 'volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1579269-6bc1-4d70-aadd-d9b98f3f3a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1579269-6bc1-4d70-aadd-d9b98f3f3a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9111e842-44e3-4ad5-885c-1378554a42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Volume aaa7e786-b7c5-4cd8-9140-563fea7f83c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3', 'volume_size': 2} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1071746474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa7e786-b7c5-4cd8-9140-563fea7f83c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd7676bae994824907f811a2182c415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:11Z,use_quota=True,user_id='0abf9cf7eff9458eb476cef04cdddad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Creating volume aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 2147483648 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:11 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 2147483648 Sep 25 16:15:11 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:11 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 2147483648" returned: 0 in 0.762s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:11 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 Sep 25 16:15:11 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:12 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" returned: 0 in 0.297s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9111e842-44e3-4ad5-885c-1378554a42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdc1327-5ad3-4956-9c3a-13bf82c8b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Volume volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 (aaa7e786-b7c5-4cd8-9140-563fea7f83c3): created successfully Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdc1327-5ad3-4956-9c3a-13bf82c8b76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Flow 'volume_create_manager' (c7d59081-446c-4d69-89ee-f19059a4e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-45573e18-820e-40bb-b036-58dceb932cb1 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Created volume successfully. Sep 25 16:15:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-54638d5d-4b48-43f3-b3bb-388c99fed143 req-f434cf60-72fa-493f-b043-8e6f8ea3418e tempest-AttachVolumeTestJSON-602691155 None] Terminate volume connection completed successfully. Sep 25 16:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-54638d5d-4b48-43f3-b3bb-388c99fed143 req-f434cf60-72fa-493f-b043-8e6f8ea3418e tempest-AttachVolumeTestJSON-602691155 None] Deleting attachment 3a41dff4-5669-49ab-bbd8-ddc9b702f05d. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Creating offline snapshot e09c235f-278d-4c07-99e7-6891999d17ea of volume aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbb6505-9fcd-456b-948c-345a00602b1c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:13 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 Sep 25 16:15:13 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:13 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" returned: 0 in 0.465s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:13 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea 2G Sep 25 16:15:13 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-762210f4-4316-4253-b440-7afbe2b9e5af req-27e15749-1ea0-4c2a-bc32-dc244cb43218 tempest-AttachVolumeTestJSON-602691155 None] Terminate volume connection completed successfully. Sep 25 16:15:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-762210f4-4316-4253-b440-7afbe2b9e5af req-27e15749-1ea0-4c2a-bc32-dc244cb43218 tempest-AttachVolumeTestJSON-602691155 None] Deleting attachment 174fe931-44b9-4cfa-9802-b82a4b8c4e33. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:14 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea 2G" returned: 0 in 0.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:14 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea Sep 25 16:15:14 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:14 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea" returned: 0 in 0.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea is being set with open permissions: ugo+rw Sep 25 16:15:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:14 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea Sep 25 16:15:14 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (b8385660-cb5c-4d6a-8921-9ded4fe2efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed780876-b1cf-4c68-aae9-7e1082fa97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed780876-b1cf-4c68-aae9-7e1082fa97af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-976671963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b37267-721b-46f4-8f0e-a4965b2d7ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:15Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c605d23f-f997-4271-ad72-56c82418fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c605d23f-f997-4271-ad72-56c82418fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2769853-2d0c-4969-851f-ce8396233378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2769853-2d0c-4969-851f-ce8396233378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b37267-721b-46f4-8f0e-a4965b2d7ef7', 'volume_name': 'volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d3bdd7-ddc4-45be-8d7a-855614057e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d3bdd7-ddc4-45be-8d7a-855614057e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4d4d03-3912-4aa3-9000-6d2e5375e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Volume 05b37267-721b-46f4-8f0e-a4965b2d7ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7', 'volume_size': 1} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:15 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea" returned: 0 in 0.431s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:15 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info Sep 25 16:15:15 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:15 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info" returned: 0 in 0.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:15 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info is being set with open permissions: ugo+rw Sep 25 16:15:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:15 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info Sep 25 16:15:15 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:16 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.info" returned: 0 in 0.505s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-976671963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b37267-721b-46f4-8f0e-a4965b2d7ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63327b806095495199497f89e78fb457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:15Z,use_quota=True,user_id='501535536cbb4d0e81e0891c3780de7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Creating volume 05b37267-721b-46f4-8f0e-a4965b2d7ef7 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:16 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:16 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 1073741824 Sep 25 16:15:16 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01f3012c-5b7b-469a-acc0-10862fe7f2ec tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Create snapshot completed successfully Sep 25 16:15:16 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 1073741824" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:17 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 Sep 25 16:15:17 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:17 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7" returned: 0 in 0.423s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4d4d03-3912-4aa3-9000-6d2e5375e156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a42287-40d8-4768-b4d2-7357deadfc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Volume volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 (05b37267-721b-46f4-8f0e-a4965b2d7ef7): created successfully Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a42287-40d8-4768-b4d2-7357deadfc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Flow 'volume_create_manager' (b8385660-cb5c-4d6a-8921-9ded4fe2efa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bce86a4d-e076-4268-a38f-0ebc1671d1a2 tempest-AttachVolumeNegativeTest-1036418157 None] Created volume successfully. Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "cinder-e09c235f-278d-4c07-99e7-6891999d17ea-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-e09c235f-278d-4c07-99e7-6891999d17ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "cinder-quobyte-e09c235f-278d-4c07-99e7-6891999d17ea" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-e09c235f-278d-4c07-99e7-6891999d17ea" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Deleting offline snapshot e09c235f-278d-4c07-99e7-6891999d17ea of volume aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] snapshot_file for this snap is: volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ac8d2-4655-4110-85b4-4ed79163542e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:17 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea Sep 25 16:15:17 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:18 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea" returned: 0 in 0.666s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:15:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453d923-01f4-4eaf-a9c8-6b3027e8dc3e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:18 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 Sep 25 16:15:18 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:19 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" returned: 0 in 0.752s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:19 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea Sep 25 16:15:19 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f6948b3c-4415-48c2-a5a9-8ddca726fe45 req-fd0f46b2-f4e8-4222-a8bb-cdc3b9a4e0e4 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f6948b3c-4415-48c2-a5a9-8ddca726fe45 req-fd0f46b2-f4e8-4222-a8bb-cdc3b9a4e0e4 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f6948b3c-4415-48c2-a5a9-8ddca726fe45 req-fd0f46b2-f4e8-4222-a8bb-cdc3b9a4e0e4 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-f6948b3c-4415-48c2-a5a9-8ddca726fe45 req-fd0f46b2-f4e8-4222-a8bb-cdc3b9a4e0e4 tempest-AttachVolumeNegativeTest-1036418157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03bc8783-703b-4e97-a1b8-d32ab8902299', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-f6948b3c-4415-48c2-a5a9-8ddca726fe45 req-fd0f46b2-f4e8-4222-a8bb-cdc3b9a4e0e4 tempest-AttachVolumeNegativeTest-1036418157 None] attachment_update completed successfully. Sep 25 16:15:19 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:19 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea Sep 25 16:15:19 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:20 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3.e09c235f-278d-4c07-99e7-6891999d17ea" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-e09c235f-278d-4c07-99e7-6891999d17ea" released by "_delete_snapshot" :: held 2.615s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" released by "delete_snapshot" :: held 2.662s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Created reservations ['ec079b62-7fce-4dba-8351-f94cd2e5e84b', 'c690e158-d5bd-4bb2-975f-cfef1c0b4449', 'ad636210-8cbd-4ced-ac8e-2747e943358f', 'e639bbc1-5386-487a-bf71-259c72d73053'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Delete snapshot completed successfully. Sep 25 16:15:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6b4cd14-8009-4560-9125-a532bedb4639 tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-e09c235f-278d-4c07-99e7-6891999d17ea-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-1a4f5268-f2d1-4315-882c-08809ef5e063-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-1a4f5268-f2d1-4315-882c-08809ef5e063-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "cinder-aaa7e786-b7c5-4cd8-9140-563fea7f83c3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-quobyte-1a4f5268-f2d1-4315-882c-08809ef5e063" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-1a4f5268-f2d1-4315-882c-08809ef5e063" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-aaa7e786-b7c5-4cd8-9140-563fea7f83c3-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ddbf8e-26b2-4d58-8535-8651a758902b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:21 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 Sep 25 16:15:21 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916138a-dd51-41f7-920f-a0d7836b89f0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:21 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 Sep 25 16:15:21 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:21 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063" returned: 0 in 0.558s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:21 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063 Sep 25 16:15:21 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:22 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" returned: 0 in 0.628s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:22 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3 Sep 25 16:15:22 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:22 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a4f5268-f2d1-4315-882c-08809ef5e063" returned: 0 in 0.383s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-1a4f5268-f2d1-4315-882c-08809ef5e063" released by "delete_volume" :: held 1.114s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Created reservations ['18a027f1-d051-4a82-935d-3a05891d51f0', 'e2e9c01c-b427-4ab4-8761-317a3dd503a7', '85024b1d-e495-4263-9254-d9938017e025', 'd07f575f-0e5e-4c7b-8725-1d2d0271eca8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:22 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:22 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:22 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" returned: 0 in 0.488s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-quobyte-aaa7e786-b7c5-4cd8-9140-563fea7f83c3" released by "delete_volume" :: held 1.226s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Created reservations ['f0ffd043-7643-4b68-844c-66d5d6b084d9', 'fa4bc0b0-b844-4d3b-8d37-4fe5dc13e075', '2ad2818f-c1a6-4791-a6d4-b3d82e3ee99d', '3d614d95-9372-4e24-80a6-50f199b9983b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:22 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:22 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7c25b4c4-28d0-4245-8a8f-9322fc2fa7ee req-3c18e68a-638b-42c0-b2f2-26a692aee1d9 tempest-AttachVolumeNegativeTest-1036418157 None] Terminate volume connection completed successfully. Sep 25 16:15:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-7c25b4c4-28d0-4245-8a8f-9322fc2fa7ee req-3c18e68a-638b-42c0-b2f2-26a692aee1d9 tempest-AttachVolumeNegativeTest-1036418157 None] Deleting attachment 03bc8783-703b-4e97-a1b8-d32ab8902299. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:23 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Deleted volume successfully. Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51e298f6-25e5-4af8-9cb5-4cf862e5d569 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-1a4f5268-f2d1-4315-882c-08809ef5e063-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:23 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Deleted volume successfully. Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aa6f2061-9dd9-40ac-af34-72d85f294dbb tempest-VolumesSnapshotNegativeTestJSON-404585203 None] Lock "cinder-aaa7e786-b7c5-4cd8-9140-563fea7f83c3-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-4326e0fe-8aad-43fe-90de-48793bc6dcaa-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-4326e0fe-8aad-43fe-90de-48793bc6dcaa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-quobyte-4326e0fe-8aad-43fe-90de-48793bc6dcaa" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-4326e0fe-8aad-43fe-90de-48793bc6dcaa" acquired by "delete_volume" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b9f5b7-7c61-4b1f-9efb-ef07069174c5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:23 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa Sep 25 16:15:23 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:24 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa" returned: 0 in 0.760s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:24 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa Sep 25 16:15:24 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:25 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4326e0fe-8aad-43fe-90de-48793bc6dcaa" returned: 0 in 0.412s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-4326e0fe-8aad-43fe-90de-48793bc6dcaa" released by "delete_volume" :: held 1.274s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Created reservations ['56f42356-d7d5-454f-b053-b09682f437da', 'e765e5d6-bbe7-41f2-a9ef-07682e5f231a', 'fd580d68-2eb0-407b-ae90-d438f939ca3d', '61b4377e-5df3-4311-9988-7e24e751046b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:25 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:25 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:25 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Deleted volume successfully. Sep 25 16:15:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efc78f19-d668-4a00-bf35-2297e1f6a08f tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-4326e0fe-8aad-43fe-90de-48793bc6dcaa-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-855a165e-ef66-44c5-aa5f-0860ceb2790e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-855a165e-ef66-44c5-aa5f-0860ceb2790e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "cinder-quobyte-855a165e-ef66-44c5-aa5f-0860ceb2790e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-855a165e-ef66-44c5-aa5f-0860ceb2790e" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c998855b-db75-4dce-ba01-10e34c6101c0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:26 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e Sep 25 16:15:26 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:26 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e Sep 25 16:15:27 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-855a165e-ef66-44c5-aa5f-0860ceb2790e" returned: 0 in 0.563s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-quobyte-855a165e-ef66-44c5-aa5f-0860ceb2790e" released by "delete_volume" :: held 1.356s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Created reservations ['971d77f9-ca95-4c10-9f75-20f426dd9f45', 'cff34621-d3d9-4ff1-81d8-b240b69a2e8b', '8e32c2dd-f444-409a-90b7-9c86ccc46caf', '3812dd4b-f5ef-43bc-99c0-7c07db388a19'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:27 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:28 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.372s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Deleted volume successfully. Sep 25 16:15:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22786683-28e0-44a2-87ab-d0aad65ad345 tempest-AttachVolumeTestJSON-602691155 None] Lock "cinder-855a165e-ef66-44c5-aa5f-0860ceb2790e-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-05b37267-721b-46f4-8f0e-a4965b2d7ef7-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-05b37267-721b-46f4-8f0e-a4965b2d7ef7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-quobyte-05b37267-721b-46f4-8f0e-a4965b2d7ef7" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-05b37267-721b-46f4-8f0e-a4965b2d7ef7" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[13297918-fb64-40b9-b97d-19b2b034abd1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:34 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 Sep 25 16:15:34 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:34 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7" returned: 0 in 0.488s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:34 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7 Sep 25 16:15:34 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:35 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05b37267-721b-46f4-8f0e-a4965b2d7ef7" returned: 0 in 0.281s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-05b37267-721b-46f4-8f0e-a4965b2d7ef7" released by "delete_volume" :: held 0.834s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Created reservations ['1e9db9ae-bf62-4338-9219-1aaedc64a0bb', 'fa2245c2-956b-481a-9d97-b6f28361a597', 'b396c1fa-668f-49a9-b93b-5deeba331bb7', 'b962c7a7-3d1a-4646-b7d6-d709d509e35b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:35 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:35 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:35 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Deleted volume successfully. Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-fee975f9-eb53-4696-b849-fd1a2cba7449-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-fee975f9-eb53-4696-b849-fd1a2cba7449-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d607c125-41ae-4bd7-943c-e62c5c02e67d tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-05b37267-721b-46f4-8f0e-a4965b2d7ef7-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-quobyte-fee975f9-eb53-4696-b849-fd1a2cba7449" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-fee975f9-eb53-4696-b849-fd1a2cba7449" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfac9c6-df05-4563-843f-f82ba4521739]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:36 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 Sep 25 16:15:36 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:36 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449" returned: 0 in 0.582s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:36 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449 Sep 25 16:15:36 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:36 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fee975f9-eb53-4696-b849-fd1a2cba7449" returned: 0 in 0.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-fee975f9-eb53-4696-b849-fd1a2cba7449" released by "delete_volume" :: held 1.006s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=94,cinder:UPDATE=95,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=96,cinder:DELETE=9,cinder:SELECT=83,cinder:INSERT=22 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Created reservations ['0981a54a-5d11-44a0-be3b-e006a29f92aa', '0e2ef550-d9bf-4f0e-8b77-bef27db6dbdc', '83631125-3d64-48c2-8264-749ebdaa1e19', 'a3850b01-2287-441b-aa78-d2d01dde7548'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:37 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:37 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:37 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.303s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Deleted volume successfully. Sep 25 16:15:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-60f1a2de-0b3c-4977-85b5-7a5c149185df tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-fee975f9-eb53-4696-b849-fd1a2cba7449-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-3eaac69d-6d46-4419-9977-efc3abc2827e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-3eaac69d-6d46-4419-9977-efc3abc2827e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "cinder-quobyte-3eaac69d-6d46-4419-9977-efc3abc2827e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-3eaac69d-6d46-4419-9977-efc3abc2827e" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ab2cb-2f28-4295-bc60-8c418918790c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:38 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e Sep 25 16:15:38 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:39 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e" returned: 0 in 0.543s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:39 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e Sep 25 16:15:39 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:39 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3eaac69d-6d46-4419-9977-efc3abc2827e" returned: 0 in 0.407s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-quobyte-3eaac69d-6d46-4419-9977-efc3abc2827e" released by "delete_volume" :: held 1.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Created reservations ['b52d7bf7-0ca7-4fc5-a4a0-b5129fcd9adc', 'c0023833-8a22-44da-9c10-4f25ecaaf6e0', '6d2605d6-3ea2-48a3-81ba-70d9467aeecb', '6a243c50-0239-4065-8552-96f39dc6a546'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:39 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:15:39 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:39 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.289s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Deleted volume successfully. Sep 25 16:15:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cda3254-66b5-4d85-af9f-635dd4724418 tempest-AttachVolumeNegativeTest-1036418157 None] Lock "cinder-3eaac69d-6d46-4419-9977-efc3abc2827e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:49 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:INSERT=3,cinder:UPDATE=14,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:49 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Flow 'volume_create_manager' (e6ec0a29-1bf3-49a2-9f1a-5099268ec518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3c02d0-9725-4c3d-826b-9a02979c92e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3c02d0-9725-4c3d-826b-9a02979c92e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-361093210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a7337-54e9-4811-896d-02c8d17d2e97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e6a4d7e12c64a8baa752554de6006a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:56Z,use_quota=True,user_id='dd460846600a43e3a21303a33c0322c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded9727-3d79-4fc4-9e50-be45b4e72a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded9727-3d79-4fc4-9e50-be45b4e72a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cd0d-1274-4e57-8f06-c80ea5fb0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cd0d-1274-4e57-8f06-c80ea5fb0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274a7337-54e9-4811-896d-02c8d17d2e97', 'volume_name': 'volume-274a7337-54e9-4811-896d-02c8d17d2e97', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7df670-c08d-47b4-9bed-a4506f65d0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7df670-c08d-47b4-9bed-a4506f65d0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a7c81-49b6-4a34-939f-155825935957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Volume 274a7337-54e9-4811-896d-02c8d17d2e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274a7337-54e9-4811-896d-02c8d17d2e97', 'volume_size': 1} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-361093210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a7337-54e9-4811-896d-02c8d17d2e97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e6a4d7e12c64a8baa752554de6006a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:56Z,use_quota=True,user_id='dd460846600a43e3a21303a33c0322c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Creating volume 274a7337-54e9-4811-896d-02c8d17d2e97 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:55 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 1073741824 Sep 25 16:15:55 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Flow 'volume_create_manager' (a671a6f5-cb9a-41f4-bae2-045653e0395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ca091-e537-491a-84e6-08374e50b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ca091-e537-491a-84e6-08374e50b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1773350501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0842e1-0419-4f6c-afc1-4086a8994f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774f4ae1744e434889c0007b4d1c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:56Z,use_quota=True,user_id='0e8a9c42ff3d4a949fb4a46254d8c739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158978c0-c578-4ee5-a9a8-a588a935a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158978c0-c578-4ee5-a9a8-a588a935a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f735b0-ba98-4ea6-b0ea-82274aad00c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f735b0-ba98-4ea6-b0ea-82274aad00c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0842e1-0419-4f6c-afc1-4086a8994f56', 'volume_name': 'volume-be0842e1-0419-4f6c-afc1-4086a8994f56', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96aa6e9-0065-4ad3-8269-583bd53f7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96aa6e9-0065-4ad3-8269-583bd53f7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4803d890-8315-412f-a0f6-1eb107adba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Volume be0842e1-0419-4f6c-afc1-4086a8994f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0842e1-0419-4f6c-afc1-4086a8994f56', 'volume_size': 1} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:56 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 1073741824" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:56 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 Sep 25 16:15:56 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:57 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97" returned: 0 in 0.449s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1773350501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0842e1-0419-4f6c-afc1-4086a8994f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774f4ae1744e434889c0007b4d1c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:56Z,use_quota=True,user_id='0e8a9c42ff3d4a949fb4a46254d8c739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Creating volume be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a7c81-49b6-4a34-939f-155825935957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274a7337-54e9-4811-896d-02c8d17d2e97', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622ad5f1-3d8d-424c-b188-1877d63ff8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:57 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 1073741824 Sep 25 16:15:57 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Volume volume-274a7337-54e9-4811-896d-02c8d17d2e97 (274a7337-54e9-4811-896d-02c8d17d2e97): created successfully Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622ad5f1-3d8d-424c-b188-1877d63ff8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Flow 'volume_create_manager' (e6ec0a29-1bf3-49a2-9f1a-5099268ec518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-e58635e3-1c0d-4682-97fa-ca01243c25b7 req-7f55ed39-c2c3-40af-a76d-5428345e74ef tempest-VolumesGetTestJSON-1811556947 None] Created volume successfully. Sep 25 16:15:57 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 1073741824" returned: 0 in 0.704s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:57 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:15:57 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:58 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.417s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4803d890-8315-412f-a0f6-1eb107adba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0842e1-0419-4f6c-afc1-4086a8994f56', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbbec2e-7991-42b6-b3fb-9df1443d6c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Volume volume-be0842e1-0419-4f6c-afc1-4086a8994f56 (be0842e1-0419-4f6c-afc1-4086a8994f56): created successfully Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbbec2e-7991-42b6-b3fb-9df1443d6c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Flow 'volume_create_manager' (a671a6f5-cb9a-41f4-bae2-045653e0395f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ef88ac36-b8ba-40c7-9495-a72a0082e729 tempest-TestImageHashVerification-914966922 None] Created volume successfully. Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Acquiring lock "cinder-274a7337-54e9-4811-896d-02c8d17d2e97-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "cinder-274a7337-54e9-4811-896d-02c8d17d2e97-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Acquiring lock "cinder-quobyte-274a7337-54e9-4811-896d-02c8d17d2e97" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "cinder-quobyte-274a7337-54e9-4811-896d-02c8d17d2e97" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2a9fb-36f4-4b63-87e1-c274f8e2e1b9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:58 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 Sep 25 16:15:58 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:59 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97" returned: 0 in 0.613s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:59 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97 Sep 25 16:15:59 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:59 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-274a7337-54e9-4811-896d-02c8d17d2e97" returned: 0 in 0.408s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "cinder-quobyte-274a7337-54e9-4811-896d-02c8d17d2e97" released by "delete_volume" :: held 1.108s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:59 devstack cinder-volume[87199]: DEBUG cinder.quota [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Created reservations ['d1e0bbe1-f96c-4d14-9f75-f5190446f94c', 'a34a139d-b77a-4c7f-866e-52be09a9492d', 'c9dbdde8-610d-4f8f-9113-e7da3a7dd12a', '744ec171-cbbb-4b17-885e-d4b1313577a8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:00 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:00 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:00 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.492s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG cinder.manager [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Deleted volume successfully. Sep 25 16:16:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-90d24fce-ca0f-4b6b-978e-9c98879206bd req-2f54a2b1-8b66-41d6-8d10-92a1a0d490fb tempest-VolumesGetTestJSON-1811556947 None] Lock "cinder-274a7337-54e9-4811-896d-02c8d17d2e97-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a21b56-e24c-4ff4-b99c-e0e79fa3d59e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:01 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:16:01 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:02 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.871s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822ccda-be82-4dfb-bae2-a0ebbe053254]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:02 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:16:02 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Flow 'volume_create_manager' (60e6f63c-c74c-4e29-be36-a3217241da34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91aa104-de97-44a8-8953-e3c9b06cf643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91aa104-de97-44a8-8953-e3c9b06cf643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1732496883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bb14ef-3411-406c-bf01-19ca858134ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37570cb5b72f4ff5a65a96766c22bf8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:03Z,use_quota=True,user_id='69758a833c184a06bb9a8f71620ea0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fee2a0-509f-4ffa-a190-97b25047e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fee2a0-509f-4ffa-a190-97b25047e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27444558-4d15-4fbf-9b4e-bc26c04b9a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27444558-4d15-4fbf-9b4e-bc26c04b9a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bb14ef-3411-406c-bf01-19ca858134ba', 'volume_name': 'volume-99bb14ef-3411-406c-bf01-19ca858134ba', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7775e0e6-f53d-4c2a-9af4-c9786a285952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7775e0e6-f53d-4c2a-9af4-c9786a285952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cdecf3-e118-495d-943a-820cd2572796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Volume 99bb14ef-3411-406c-bf01-19ca858134ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bb14ef-3411-406c-bf01-19ca858134ba', 'volume_size': 1} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 /opt/stack/data/cinder/conversion/be0842e1-0419-4f6c-afc1-4086a8994f56.temp_image.d61c2663-87d2-4e7b-a633-d97f5dcf8c839yyce7q7.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:02 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 /opt/stack/data/cinder/conversion/be0842e1-0419-4f6c-afc1-4086a8994f56.temp_image.d61c2663-87d2-4e7b-a633-d97f5dcf8c839yyce7q7.img Sep 25 16:16:02 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:06 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:06 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:06 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.887s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:16:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:16:11 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 /opt/stack/data/cinder/conversion/be0842e1-0419-4f6c-afc1-4086a8994f56.temp_image.d61c2663-87d2-4e7b-a633-d97f5dcf8c839yyce7q7.img" returned: 0 in 8.745s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa4e4c-9bed-4769-8230-4ccba431c295]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:11 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:16:11 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:12 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.635s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:12 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/conversion/be0842e1-0419-4f6c-afc1-4086a8994f56.temp_image.d61c2663-87d2-4e7b-a633-d97f5dcf8c839yyce7q7.img {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:16:12 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Converted 1024.00 MB image at 117.04 MB/s Sep 25 16:16:12 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] d61c2663-87d2-4e7b-a633-d97f5dcf8c83 was raw, no need to convert to raw {{(pid=87199) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 16:16:22 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=18,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:22 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Flow 'volume_create_manager' (2c6e3a52-df6a-4f97-8a50-6e8abb15b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b61be6b-0342-4723-9399-be8981e83cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b61be6b-0342-4723-9399-be8981e83cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1778396132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c03c98-cba8-4c9f-bc7a-70e6ffc17c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c116121f97f4fe98b979e1fdae7faee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:33Z,use_quota=True,user_id='5498ec5686f34f73b459bbcd096ce251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0449e3-d14a-4599-b2a9-280e67a128ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0449e3-d14a-4599-b2a9-280e67a128ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68574342-bfa1-43f7-a9ff-216b34f8fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68574342-bfa1-43f7-a9ff-216b34f8fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c03c98-cba8-4c9f-bc7a-70e6ffc17c16', 'volume_name': 'volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08129b7-b9a3-49fb-b0f6-ca5fb60179b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08129b7-b9a3-49fb-b0f6-ca5fb60179b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aac7576-91b3-4917-8042-39c4da4fb715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Volume 50c03c98-cba8-4c9f-bc7a-70e6ffc17c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16', 'volume_size': 1} Sep 25 16:16:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Flow 'volume_create_manager' (b0ab5287-a77d-475a-938a-a0f3b12c1a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a41e88a-eb31-45eb-b748-f4014dddccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a41e88a-eb31-45eb-b748-f4014dddccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-391745346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945cadd-6934-4381-ad40-6fe8f47d01cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454cd18a4824c048eb2844a57b69bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:36Z,use_quota=True,user_id='91fb6d7255e0424686f9b920fe53fbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73214c-2e3d-44b1-ac7e-fa4c06ba7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73214c-2e3d-44b1-ac7e-fa4c06ba7da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5142956-26c6-4c1f-ac78-1353edb2d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5142956-26c6-4c1f-ac78-1353edb2d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7945cadd-6934-4381-ad40-6fe8f47d01cc', 'volume_name': 'volume-7945cadd-6934-4381-ad40-6fe8f47d01cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b298706-f890-4b28-a447-badc16832c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b298706-f890-4b28-a447-badc16832c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c8df1-783b-462b-bafb-7fb1807b68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume 7945cadd-6934-4381-ad40-6fe8f47d01cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7945cadd-6934-4381-ad40-6fe8f47d01cc', 'volume_size': 1} Sep 25 16:16:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.821s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Uploaded volume to glance image-id: d61c2663-87d2-4e7b-a633-d97f5dcf8c83. {{(pid=87199) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 40.124s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1732496883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bb14ef-3411-406c-bf01-19ca858134ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37570cb5b72f4ff5a65a96766c22bf8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:03Z,use_quota=True,user_id='69758a833c184a06bb9a8f71620ea0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Creating volume 99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:43 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba 1073741824 Sep 25 16:16:43 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9e9e724c-ea1b-439e-be22-e89005bbd89f tempest-TestImageHashVerification-914966922 None] Copy volume to image completed successfully. Sep 25 16:16:43 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba 1073741824" returned: 0 in 0.545s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:43 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba Sep 25 16:16:43 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Acquiring lock "cinder-be0842e1-0419-4f6c-afc1-4086a8994f56-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "cinder-be0842e1-0419-4f6c-afc1-4086a8994f56-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Acquiring lock "cinder-quobyte-be0842e1-0419-4f6c-afc1-4086a8994f56" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "cinder-quobyte-be0842e1-0419-4f6c-afc1-4086a8994f56" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd2e7a-fd0f-4d90-b5a4-c6fc067a48f8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:43 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.951s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1778396132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c03c98-cba8-4c9f-bc7a-70e6ffc17c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c116121f97f4fe98b979e1fdae7faee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:33Z,use_quota=True,user_id='5498ec5686f34f73b459bbcd096ce251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Creating volume 50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cdecf3-e118-495d-943a-820cd2572796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bb14ef-3411-406c-bf01-19ca858134ba', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:43 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 1073741824 Sep 25 16:16:43 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b128aba-f328-4f88-83e9-a6d33143b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Volume volume-99bb14ef-3411-406c-bf01-19ca858134ba (99bb14ef-3411-406c-bf01-19ca858134ba): created successfully Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b128aba-f328-4f88-83e9-a6d33143b396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Flow 'volume_create_manager' (60e6f63c-c74c-4e29-be36-a3217241da34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:43 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:16:43 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-9c2181ee-c05d-4c97-8b89-264e1f0504db req-bd808c2c-b2f7-40af-9daa-a8b11b5f4c66 tempest-VolumesSnapshotsTestJSON-1589981755 None] Created volume successfully. Sep 25 16:16:44 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.452s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:44 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56 Sep 25 16:16:44 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:44 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 1073741824" returned: 0 in 0.578s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:44 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 Sep 25 16:16:44 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:44 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-be0842e1-0419-4f6c-afc1-4086a8994f56" returned: 0 in 0.417s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "cinder-quobyte-be0842e1-0419-4f6c-afc1-4086a8994f56" released by "delete_volume" :: held 0.920s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Created reservations ['21250c0a-ae63-4335-bbb7-214ca74f9f01', '39557d5b-e6c3-4818-95e3-f7849ef1da44', '31220e5d-7e61-4d9d-b1d4-341dbe8c9e9d', '36d3063d-ce63-4db3-9698-f9a9e2eb14bc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:44 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.149s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-391745346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945cadd-6934-4381-ad40-6fe8f47d01cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454cd18a4824c048eb2844a57b69bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:36Z,use_quota=True,user_id='91fb6d7255e0424686f9b920fe53fbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Creating volume 7945cadd-6934-4381-ad40-6fe8f47d01cc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:44 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:44 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aac7576-91b3-4917-8042-39c4da4fb715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1a25e-916b-4140-a614-217f572bed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:45 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc 1073741824 Sep 25 16:16:45 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Volume volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 (50c03c98-cba8-4c9f-bc7a-70e6ffc17c16): created successfully Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1a25e-916b-4140-a614-217f572bed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Flow 'volume_create_manager' (2c6e3a52-df6a-4f97-8a50-6e8abb15b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-adcb142d-c7a0-411f-afd7-32fdd557f1ca tempest-TestMinimumBasicScenario-618995918 None] Created volume successfully. Sep 25 16:16:45 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Deleted volume successfully. Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ed2d730-6a91-4e67-802d-e4620ae0df57 tempest-TestImageHashVerification-914966922 None] Lock "cinder-be0842e1-0419-4f6c-afc1-4086a8994f56-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:45 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc 1073741824" returned: 0 in 0.660s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:45 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc Sep 25 16:16:45 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:45 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc" returned: 0 in 0.315s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.255s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c8df1-783b-462b-bafb-7fb1807b68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7945cadd-6934-4381-ad40-6fe8f47d01cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba5317-4b18-40df-adff-a2806b676d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Creating offline snapshot 988a5a72-7782-463e-ab1b-528305a6f943 of volume 99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:16:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume volume-7945cadd-6934-4381-ad40-6fe8f47d01cc (7945cadd-6934-4381-ad40-6fe8f47d01cc): created successfully Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba5317-4b18-40df-adff-a2806b676d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Flow 'volume_create_manager' (b0ab5287-a77d-475a-938a-a0f3b12c1a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b7939-9d3f-4a6c-8b9c-bdcb1d89a26d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-47f4b71d-8b4c-47dc-ab43-893441d01780 tempest-VolumeQuotasAdminTestJSON-701877178 None] Created volume successfully. Sep 25 16:16:46 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba Sep 25 16:16:46 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:46 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba" returned: 0 in 0.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "cinder-7945cadd-6934-4381-ad40-6fe8f47d01cc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:46 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 1G Sep 25 16:16:46 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "cinder-7945cadd-6934-4381-ad40-6fe8f47d01cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "cinder-quobyte-7945cadd-6934-4381-ad40-6fe8f47d01cc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "cinder-quobyte-7945cadd-6934-4381-ad40-6fe8f47d01cc" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f4f21a-c046-4903-9910-b8430fd18e4d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:47 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc Sep 25 16:16:47 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ab318caa-caf6-42e6-b8a5-9228034ad9e0 req-59752450-1099-4216-80c3-b52d0aa900e5 tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:47 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 1G" returned: 0 in 0.609s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bb14ef-3411-406c-bf01-19ca858134ba -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:47 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bb14ef-3411-406c-bf01-19ca858134ba -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 Sep 25 16:16:47 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:47 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc" returned: 0 in 0.570s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:47 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc Sep 25 16:16:47 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:47 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bb14ef-3411-406c-bf01-19ca858134ba -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:47 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 is being set with open permissions: ugo+rw Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:47 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 Sep 25 16:16:47 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:47 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7945cadd-6934-4381-ad40-6fe8f47d01cc" returned: 0 in 0.344s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "cinder-quobyte-7945cadd-6934-4381-ad40-6fe8f47d01cc" released by "delete_volume" :: held 0.986s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Created reservations ['c160fd59-a139-41ef-a729-572aa06df223', 'cf44d11a-13f4-4e8e-a458-b8d54455ada4', '31d56d6a-0a85-480a-88ab-86b65b79b282', '30ffc351-d297-4146-b83e-b133cca5792a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:48 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:48 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:48 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943" returned: 0 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:48 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info Sep 25 16:16:48 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:48 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.275s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Deleted volume successfully. Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a0b7a8be-36a1-44ec-a5a4-0a081d69a851 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "cinder-7945cadd-6934-4381-ad40-6fe8f47d01cc-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:48 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:48 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info is being set with open permissions: ugo+rw Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:48 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info Sep 25 16:16:48 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:48 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.info" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ab318caa-caf6-42e6-b8a5-9228034ad9e0 req-59752450-1099-4216-80c3-b52d0aa900e5 tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.598s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ab318caa-caf6-42e6-b8a5-9228034ad9e0 req-59752450-1099-4216-80c3-b52d0aa900e5 tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-1610e935-25f2-4f1b-905e-bad7738e9f9f req-28cc76e6-6a38-4b6a-b2a1-be2a43675853 tempest-VolumesSnapshotsTestJSON-1589981755 None] Create snapshot completed successfully Sep 25 16:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ab318caa-caf6-42e6-b8a5-9228034ad9e0 req-59752450-1099-4216-80c3-b52d0aa900e5 tempest-TestMinimumBasicScenario-618995918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe744d73-f70a-422c-b159-06ed1ace1d90', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ab318caa-caf6-42e6-b8a5-9228034ad9e0 req-59752450-1099-4216-80c3-b52d0aa900e5 tempest-TestMinimumBasicScenario-618995918 None] attachment_update completed successfully. Sep 25 16:16:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "cinder-988a5a72-7782-463e-ab1b-528305a6f943-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-988a5a72-7782-463e-ab1b-528305a6f943-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Flow 'volume_create_manager' (f6f0dbb2-ecee-4bc1-89ad-407fa42aab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a95fb01-700f-40fb-a578-0f89c5c4e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" acquired by "delete_snapshot" :: waited 0.089s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "cinder-quobyte-988a5a72-7782-463e-ab1b-528305a6f943" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-988a5a72-7782-463e-ab1b-528305a6f943" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Deleting offline snapshot 988a5a72-7782-463e-ab1b-528305a6f943 of volume 99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] snapshot_file for this snap is: volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a95fb01-700f-40fb-a578-0f89c5c4e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1652485747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0c4632-0237-4c7b-ba2e-4a78f99c71eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454cd18a4824c048eb2844a57b69bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:50Z,use_quota=True,user_id='91fb6d7255e0424686f9b920fe53fbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ad7d75-9cb7-4c4c-bf98-c06299a1594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ad7d75-9cb7-4c4c-bf98-c06299a1594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d75fcf-2163-49dd-9ec3-4b4571825430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d75fcf-2163-49dd-9ec3-4b4571825430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0c4632-0237-4c7b-ba2e-4a78f99c71eb', 'volume_name': 'volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69e36b0-fe83-4852-9628-ef1b5f72034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69e36b0-fe83-4852-9628-ef1b5f72034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d6f12-e470-4d0d-8e6d-a4fe0f83201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume 1a0c4632-0237-4c7b-ba2e-4a78f99c71eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb', 'volume_size': 1} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1652485747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0c4632-0237-4c7b-ba2e-4a78f99c71eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0454cd18a4824c048eb2844a57b69bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:50Z,use_quota=True,user_id='91fb6d7255e0424686f9b920fe53fbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Creating volume 1a0c4632-0237-4c7b-ba2e-4a78f99c71eb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70ad6f-16c8-45ff-93b8-582ff1562b93]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:50 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb 1073741824 Sep 25 16:16:50 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:50 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 Sep 25 16:16:50 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:51 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943" returned: 0 in 0.651s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99bb14ef-3411-406c-bf01-19ca858134ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b486a-d041-44c7-8a5b-1cdfe82d039f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:51 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb 1073741824" returned: 0 in 0.763s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:51 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb Sep 25 16:16:51 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:51 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba Sep 25 16:16:51 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:51 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" returned: 0 in 0.521s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d6f12-e470-4d0d-8e6d-a4fe0f83201d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77e12e7-bbc1-4743-992b-ca1a6c331721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Volume volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb (1a0c4632-0237-4c7b-ba2e-4a78f99c71eb): created successfully Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77e12e7-bbc1-4743-992b-ca1a6c331721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Flow 'volume_create_manager' (f6f0dbb2-ecee-4bc1-89ad-407fa42aab84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:51 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba" returned: 0 in 0.690s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-acea8d1c-4b68-43ee-a207-a69f21ff76d8 tempest-VolumeQuotasAdminTestJSON-701877178 None] Created volume successfully. Sep 25 16:16:51 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 Sep 25 16:16:51 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:52 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943" returned: 0 in 0.445s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:52 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943 Sep 25 16:16:52 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:52 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba.988a5a72-7782-463e-ab1b-528305a6f943" returned: 0 in 0.432s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-988a5a72-7782-463e-ab1b-528305a6f943" released by "_delete_snapshot" :: held 2.606s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" released by "delete_snapshot" :: held 2.648s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:52 devstack cinder-volume[87199]: DEBUG cinder.quota [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Created reservations ['08206f93-5c32-48b0-9b4d-961587370096', 'fa4c674e-0d39-427f-b5aa-e1b1d657a353', '02449c3f-ad78-48a7-996f-454c96691583', '9a029c54-3707-4829-9faa-92a1560218ac'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Delete snapshot completed successfully. Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-3ba8db29-f60d-46ac-91fd-96e7b8818f6e req-8ff6cfa4-a123-4c97-bf30-8020c8c7d949 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-988a5a72-7782-463e-ab1b-528305a6f943-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1c379401-de1b-46b8-ac95-f34d7b8444b4 tempest-VolumeQuotasAdminTestJSON-691643312 None] Transfer volume completed successfully. Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "cinder-99bb14ef-3411-406c-bf01-19ca858134ba-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-99bb14ef-3411-406c-bf01-19ca858134ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ce1d6-b796-47fb-b6b4-d0f4beb77b6c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Acquiring lock "cinder-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "cinder-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:54 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba Sep 25 16:16:54 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Acquiring lock "cinder-quobyte-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "cinder-quobyte-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2781a51f-95ed-45c9-9604-8d505168e95d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:54 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb Sep 25 16:16:54 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:54 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba" returned: 0 in 0.528s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:54 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba Sep 25 16:16:54 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:54 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:54 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99bb14ef-3411-406c-bf01-19ca858134ba" returned: 0 in 0.549s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" returned: 0 in 0.801s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-quobyte-99bb14ef-3411-406c-bf01-19ca858134ba" released by "delete_volume" :: held 1.203s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:54 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb Sep 25 16:16:54 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.quota [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Created reservations ['5ddcf653-7b10-406b-bb14-0374c7a5702f', 'ab058e7d-cd34-45d4-8dc1-ef54e17a6630', '3258b1eb-bfc3-4570-9a11-201d6945a0c7', 'f098ea90-7bce-4871-8ce9-d471f47d456c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:55 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:55 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:55 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "cinder-quobyte-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb" released by "delete_volume" :: held 1.364s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:55 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.387s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.manager [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Created reservations ['0c8b7d3c-53f6-438e-9094-40c7b2065002', '7758e31a-e144-4afa-bbe2-e7180dd1eb2f', 'cb9e73b3-8c49-4cd2-a5b1-e597a0824034', '6e04fe8a-a58e-4fd7-946c-b15ae5295862'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Deleted volume successfully. Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-ec85d04a-0815-4b84-bc0e-661fe0ae9804 req-d9798161-39f4-44b3-90ec-2356a8ca0c06 tempest-VolumesSnapshotsTestJSON-1589981755 None] Lock "cinder-99bb14ef-3411-406c-bf01-19ca858134ba-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:55 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:16:55 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:56 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Deleted volume successfully. Sep 25 16:16:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec1e77f2-9d0c-4588-80b4-8845cb4bbfc3 tempest-VolumeQuotasAdminTestJSON-1170624956 None] Lock "cinder-1a0c4632-0237-4c7b-ba2e-4a78f99c71eb-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5f546afb-32c4-4d62-bee5-6bbb07769861 tempest-BackendsCapabilitiesAdminTestsJSON-218000964 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:17:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-daa241eb-a7c1-46b8-8558-e11dc0afd675 tempest-BackendsCapabilitiesAdminTestsJSON-218000964 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (4a59389e-9d39-4e24-bbff-b08b0ef0ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e542fc-d928-4cf0-8d95-8b0a319a8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e542fc-d928-4cf0-8d95-8b0a319a8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2127196930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae9602c-a945-4502-84d5-819dc8e717d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:05Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658fb666-b09f-4899-b833-4fc774fa4d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658fb666-b09f-4899-b833-4fc774fa4d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bf034-7958-4f8d-b85e-f2e16e6f3b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bf034-7958-4f8d-b85e-f2e16e6f3b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae9602c-a945-4502-84d5-819dc8e717d1', 'volume_name': 'volume-aae9602c-a945-4502-84d5-819dc8e717d1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4b9956-e7c4-42be-88f0-c42117e0884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4b9956-e7c4-42be-88f0-c42117e0884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1efa8ac-48b1-4f27-af1c-5ac38a96c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Volume aae9602c-a945-4502-84d5-819dc8e717d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae9602c-a945-4502-84d5-819dc8e717d1', 'volume_size': 1} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2127196930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae9602c-a945-4502-84d5-819dc8e717d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:05Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Creating volume aae9602c-a945-4502-84d5-819dc8e717d1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:05 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:05 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 1073741824 Sep 25 16:17:05 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:06 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:06 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (89a8e7f9-12f3-4257-9446-4a0c20872ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962828a-ab15-4d46-8cc0-434cb462663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962828a-ab15-4d46-8cc0-434cb462663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079489624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc033ae-ec0f-4154-926a-6d1409d8f8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:06Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebfba65-6329-4bb5-ba81-aade44a04d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebfba65-6329-4bb5-ba81-aade44a04d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c6b34-bd6a-436f-9700-66624b5bb1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c6b34-bd6a-436f-9700-66624b5bb1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc033ae-ec0f-4154-926a-6d1409d8f8f4', 'volume_name': 'volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170fd8ee-a5ce-4a3b-a0cd-47bf6ca286c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170fd8ee-a5ce-4a3b-a0cd-47bf6ca286c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f01da28-0e1d-4c98-bce2-8471eedabeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Volume 5dc033ae-ec0f-4154-926a-6d1409d8f8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4', 'volume_size': 1} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:06 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 1073741824" returned: 0 in 0.983s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:06 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 Sep 25 16:17:06 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:06 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:17:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:06 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (43041c0b-8a4c-4003-9476-9c34e8bfe153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eb75b1-bb93-45ca-8142-af4e81329c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1" returned: 0 in 0.516s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079489624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc033ae-ec0f-4154-926a-6d1409d8f8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:06Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Creating volume 5dc033ae-ec0f-4154-926a-6d1409d8f8f4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:07 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:07 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 1073741824 Sep 25 16:17:07 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eb75b1-bb93-45ca-8142-af4e81329c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399164531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002fdac7-8216-4e7d-8c6b-d7322a69ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:07Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181a6299-de2b-4b17-86a0-f838653e278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181a6299-de2b-4b17-86a0-f838653e278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7de1b0-c351-4f84-b121-c2875202253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7de1b0-c351-4f84-b121-c2875202253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002fdac7-8216-4e7d-8c6b-d7322a69ee8a', 'volume_name': 'volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b46d35a-ebf2-4865-bf75-646e092c314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b46d35a-ebf2-4865-bf75-646e092c314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45f16c5-bc20-4861-bca6-7be54c5283e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Volume 002fdac7-8216-4e7d-8c6b-d7322a69ee8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a', 'volume_size': 1} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1efa8ac-48b1-4f27-af1c-5ac38a96c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae9602c-a945-4502-84d5-819dc8e717d1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b716b1-3292-4293-a2e1-01739c66b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Volume volume-aae9602c-a945-4502-84d5-819dc8e717d1 (aae9602c-a945-4502-84d5-819dc8e717d1): created successfully Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b716b1-3292-4293-a2e1-01739c66b406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (4a59389e-9d39-4e24-bbff-b08b0ef0ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c4ce8141-c34f-4564-a721-8d63476e78c9 tempest-CreateVolumesFromImageTest-1534751289 None] Created volume successfully. Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (8fd7ae57-a6ec-4f78-99d3-debcf06bb538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d299bc45-394c-4f8b-b9c3-6957a1a84d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d299bc45-394c-4f8b-b9c3-6957a1a84d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1457794072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755a15a-48dc-4018-9521-d06b31be5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:08Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d7cda1-e877-4640-b090-dd71a4d5957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d7cda1-e877-4640-b090-dd71a4d5957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef38af25-b9b4-4465-94ba-cc57fe7970f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef38af25-b9b4-4465-94ba-cc57fe7970f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6755a15a-48dc-4018-9521-d06b31be5b9d', 'volume_name': 'volume-6755a15a-48dc-4018-9521-d06b31be5b9d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38e246a-1cc0-443f-a6ac-27d81cea5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38e246a-1cc0-443f-a6ac-27d81cea5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80384a82-532f-4544-832e-77f94534ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Volume 6755a15a-48dc-4018-9521-d06b31be5b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6755a15a-48dc-4018-9521-d06b31be5b9d', 'volume_size': 1} Sep 25 16:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:08 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 1073741824" returned: 0 in 1.075s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 Sep 25 16:17:08 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (ae314b99-7476-4a03-abdb-0409b1c4dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5c6770-6440-4620-b15b-d8096a50575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5c6770-6440-4620-b15b-d8096a50575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514630040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f72157f-d2ae-4c8e-98e1-943a996a31e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:08Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66652573-ae47-4f96-8c84-93b92f372ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66652573-ae47-4f96-8c84-93b92f372ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66714448-7c8b-4a6d-8934-16d0d6ecd177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66714448-7c8b-4a6d-8934-16d0d6ecd177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f72157f-d2ae-4c8e-98e1-943a996a31e2', 'volume_name': 'volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e83e29-32ce-45ed-ba6f-dd759bc3723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e83e29-32ce-45ed-ba6f-dd759bc3723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bae830a-8e73-4638-b03d-d56cc2ee6abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Volume 2f72157f-d2ae-4c8e-98e1-943a996a31e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2', 'volume_size': 1} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:08 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" returned: 0 in 0.444s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399164531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002fdac7-8216-4e7d-8c6b-d7322a69ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:07Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Creating volume 002fdac7-8216-4e7d-8c6b-d7322a69ee8a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:08 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f01da28-0e1d-4c98-bce2-8471eedabeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a 1073741824 Sep 25 16:17:08 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9da15-e609-4057-a786-2f2336388b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Volume volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 (5dc033ae-ec0f-4154-926a-6d1409d8f8f4): created successfully Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9da15-e609-4057-a786-2f2336388b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (89a8e7f9-12f3-4257-9446-4a0c20872ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bb5354e4-3422-4922-a188-c1e807915f9b tempest-CreateVolumesFromImageTest-1534751289 None] Created volume successfully. Sep 25 16:17:09 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a 1073741824" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:09 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a Sep 25 16:17:09 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:09 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" returned: 0 in 0.349s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1457794072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755a15a-48dc-4018-9521-d06b31be5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:08Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Creating volume 6755a15a-48dc-4018-9521-d06b31be5b9d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45f16c5-bc20-4861-bca6-7be54c5283e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:09 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d 1073741824 Sep 25 16:17:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86de6ef-0567-4458-b6a9-6f84e7a32639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:09 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Volume volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a (002fdac7-8216-4e7d-8c6b-d7322a69ee8a): created successfully Sep 25 16:17:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86de6ef-0567-4458-b6a9-6f84e7a32639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (43041c0b-8a4c-4003-9476-9c34e8bfe153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-49446501-d222-44fb-ad6f-2c50410b90ce tempest-CreateVolumesFromImageTest-1534751289 None] Created volume successfully. Sep 25 16:17:10 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d 1073741824" returned: 0 in 0.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:10 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d Sep 25 16:17:10 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d" returned: 0 in 0.378s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514630040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f72157f-d2ae-4c8e-98e1-943a996a31e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83caff0cc32d41af92f184d8da438684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:08Z,use_quota=True,user_id='6521bbabe07440b99bafa872744657d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Creating volume 2f72157f-d2ae-4c8e-98e1-943a996a31e2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80384a82-532f-4544-832e-77f94534ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6755a15a-48dc-4018-9521-d06b31be5b9d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e09a6-fc4a-4f33-bb90-43cdaf0651b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 1073741824 Sep 25 16:17:11 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Volume volume-6755a15a-48dc-4018-9521-d06b31be5b9d (6755a15a-48dc-4018-9521-d06b31be5b9d): created successfully Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e09a6-fc4a-4f33-bb90-43cdaf0651b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (8fd7ae57-a6ec-4f78-99d3-debcf06bb538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cf85cb85-f689-45bd-909d-4dafb7166179 tempest-CreateVolumesFromImageTest-1534751289 None] Created volume successfully. Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Flow 'volume_create_manager' (7ddcefcc-3b3b-4122-9f89-95e3cc791e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bc7543-2289-4822-830e-551c5692004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bc7543-2289-4822-830e-551c5692004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1755471562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476e91da-35f6-440c-a8c8-f6aa5da3ffe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79bacd100a141078b4d2efcf3829f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:12Z,use_quota=True,user_id='257533ec7dfb4fe880db3e0b1fd202e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8729d03f-407d-4bea-b99d-cde1a1bfe4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8729d03f-407d-4bea-b99d-cde1a1bfe4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1e620a-d104-463f-9671-49371467eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1e620a-d104-463f-9671-49371467eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476e91da-35f6-440c-a8c8-f6aa5da3ffe5', 'volume_name': 'volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689b16e3-ca6a-4526-9178-dd61b6e9345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689b16e3-ca6a-4526-9178-dd61b6e9345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd063f65-616d-4c4e-8e78-79eb1922c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Volume 476e91da-35f6-440c-a8c8-f6aa5da3ffe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5', 'volume_size': 1} Sep 25 16:17:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:12 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 1073741824" returned: 0 in 0.822s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:12 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 Sep 25 16:17:12 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1755471562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476e91da-35f6-440c-a8c8-f6aa5da3ffe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79bacd100a141078b4d2efcf3829f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:12Z,use_quota=True,user_id='257533ec7dfb4fe880db3e0b1fd202e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Creating volume 476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:12 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bae830a-8e73-4638-b03d-d56cc2ee6abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb75a84-66b3-4bed-847b-fa9c4e593c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:12 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 1073741824 Sep 25 16:17:12 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Volume volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 (2f72157f-d2ae-4c8e-98e1-943a996a31e2): created successfully Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb75a84-66b3-4bed-847b-fa9c4e593c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Flow 'volume_create_manager' (ae314b99-7476-4a03-abdb-0409b1c4dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e3bb692f-51f9-48a4-b8c4-5947b0d7bea2 tempest-CreateVolumesFromImageTest-1534751289 None] Created volume successfully. Sep 25 16:17:13 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 1073741824" returned: 0 in 0.633s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-2f72157f-d2ae-4c8e-98e1-943a996a31e2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:13 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 Sep 25 16:17:13 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-2f72157f-d2ae-4c8e-98e1-943a996a31e2-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-quobyte-2f72157f-d2ae-4c8e-98e1-943a996a31e2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-2f72157f-d2ae-4c8e-98e1-943a996a31e2" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6d3d2-6892-43a2-8752-ae8e5cdfc263]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:13 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 Sep 25 16:17:13 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:13 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" returned: 0 in 0.555s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd063f65-616d-4c4e-8e78-79eb1922c415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866d3650-208b-495d-936a-d3a96c7d6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Volume volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 (476e91da-35f6-440c-a8c8-f6aa5da3ffe5): created successfully Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866d3650-208b-495d-936a-d3a96c7d6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Flow 'volume_create_manager' (7ddcefcc-3b3b-4122-9f89-95e3cc791e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4f184746-c986-4bd4-81b8-c0b930af26e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Created volume successfully. Sep 25 16:17:14 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2" returned: 0 in 0.609s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:14 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2 Sep 25 16:17:14 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2f72157f-d2ae-4c8e-98e1-943a996a31e2" returned: 0 in 0.323s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-2f72157f-d2ae-4c8e-98e1-943a996a31e2" released by "delete_volume" :: held 1.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Created reservations ['93c802b5-5ba7-454d-9360-82cf25fdb9ad', '1eb68844-6a39-44f6-9a33-a10659ba5c0e', 'cdcf5ac5-32c1-4b9c-b168-fa871330b51e', 'fea04783-27e6-4322-9af3-dae528daf6ab'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:14 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:14 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.348s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Deleted volume successfully. Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-595dfe63-630d-4a52-a222-ac172e23b618 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-2f72157f-d2ae-4c8e-98e1-943a996a31e2-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Creating offline snapshot b3828a85-7fff-4179-96a9-959d54ad8a4a of volume 476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715a206-5958-4294-9a57-dc178a9494e1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:15 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 Sep 25 16:17:15 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-6755a15a-48dc-4018-9521-d06b31be5b9d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-6755a15a-48dc-4018-9521-d06b31be5b9d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-quobyte-6755a15a-48dc-4018-9521-d06b31be5b9d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-6755a15a-48dc-4018-9521-d06b31be5b9d" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d903b92-21c7-4a5e-a485-50ee206e3961 tempest-GroupSnapshotsV319Test-42149439 None] Group tempest-GroupSnapshotsV319Test-Group-274758796: creating Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9d0f36-9ce7-496e-bebc-0cf79e400763]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d903b92-21c7-4a5e-a485-50ee206e3961 tempest-GroupSnapshotsV319Test-42149439 None] Group tempest-GroupSnapshotsV319Test-Group-274758796: created successfully Sep 25 16:17:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d903b92-21c7-4a5e-a485-50ee206e3961 tempest-GroupSnapshotsV319Test-42149439 None] Create group completed successfully. Sep 25 16:17:15 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" returned: 0 in 0.539s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:15 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d Sep 25 16:17:15 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:15 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a 1G Sep 25 16:17:15 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:16 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d" returned: 0 in 0.504s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d Sep 25 16:17:16 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:16 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a 1G" returned: 0 in 0.564s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a Sep 25 16:17:16 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:16 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6755a15a-48dc-4018-9521-d06b31be5b9d" returned: 0 in 0.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-6755a15a-48dc-4018-9521-d06b31be5b9d" released by "delete_volume" :: held 0.868s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Created reservations ['6ed04004-808c-43b6-9dbd-7ca91c8abf3f', '977dee89-ab03-4b70-a9a8-508dde8b87da', '2c8a6cd6-30c2-4e2b-8ab3-bdacb5ffc626', '39758b3b-fcbe-417d-ab7a-a12254cf17e1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:16 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-002fdac7-8216-4e7d-8c6b-d7322a69ee8a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-002fdac7-8216-4e7d-8c6b-d7322a69ee8a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-quobyte-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:16 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:16 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a is being set with open permissions: ugo+rw Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f12c62-4c38-4688-b16f-80153a851880]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a Sep 25 16:17:16 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.403s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Deleted volume successfully. Sep 25 16:17:17 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a Sep 25 16:17:17 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-54206315-5279-44e9-b6f8-3a4c26d7897b tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-6755a15a-48dc-4018-9521-d06b31be5b9d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:17 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a" returned: 0 in 0.359s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:17 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info Sep 25 16:17:17 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" returned: 0 in 0.533s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:17 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a Sep 25 16:17:17 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info" returned: 0 in 0.404s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info is being set with open permissions: ugo+rw Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:17 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info Sep 25 16:17:17 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Flow 'volume_create_manager' (5c2b4a49-1550-4ad9-90b1-e2f86af2bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8356314-01de-40db-97d9-a213a2ed5537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" returned: 0 in 0.444s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8356314-01de-40db-97d9-a213a2ed5537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914083247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa1f2915-c919-426d-b02a-56fc04407fc1,host='devstack@QuobyteHD#QuobyteHD',id=7b767429-e098-498d-a4bf-ddb886be0ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff10e9d72265437c9674b51b42ceb8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:18Z,use_quota=True,user_id='1ae5e020b84143ee8978415b1de0f983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f43f89a-297c-434a-9dfc-5ae95656ecb1),volume_type_id=5f43f89a-297c-434a-9dfc-5ae95656ecb1)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc0fcce-d120-4aa6-ab74-21241ab8a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc0fcce-d120-4aa6-ab74-21241ab8a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab3560e-d3d4-4015-a0ca-1f6657f7bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab3560e-d3d4-4015-a0ca-1f6657f7bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b767429-e098-498d-a4bf-ddb886be0ee8', 'volume_name': 'volume-7b767429-e098-498d-a4bf-ddb886be0ee8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ded0968-8629-4623-b550-10f859aa1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ded0968-8629-4623-b550-10f859aa1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0c75de-89b3-4b16-b462-595508c51d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Volume 7b767429-e098-498d-a4bf-ddb886be0ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b767429-e098-498d-a4bf-ddb886be0ee8', 'volume_size': 1} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-002fdac7-8216-4e7d-8c6b-d7322a69ee8a" released by "delete_volume" :: held 1.111s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Created reservations ['915b8e62-b033-40a0-b378-cb8f12630c18', '1cc65e88-b204-49e5-bf20-73ede5dc9a0b', '5a00fcf7-7eb2-400b-bb48-6db7e4f36e97', 'e77b87ab-7014-4baa-8fa3-62cea0f102e8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:18 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.info" returned: 0 in 0.370s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:18 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:18 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa1f2915-c919-426d-b02a-56fc04407fc1,created_at=2026-09-25T14:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914083247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa1f2915-c919-426d-b02a-56fc04407fc1,host='devstack@QuobyteHD#QuobyteHD',id=7b767429-e098-498d-a4bf-ddb886be0ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff10e9d72265437c9674b51b42ceb8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:18Z,use_quota=True,user_id='1ae5e020b84143ee8978415b1de0f983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f43f89a-297c-434a-9dfc-5ae95656ecb1),volume_type_id=5f43f89a-297c-434a-9dfc-5ae95656ecb1)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Creating volume 7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:18 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 1073741824 Sep 25 16:17:18 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-09ef5731-1cde-4d1e-9ace-42615d230c81 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Create snapshot completed successfully Sep 25 16:17:18 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Deleted volume successfully. Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4405b999-a930-4989-afbf-4a5c9284e7b1 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-002fdac7-8216-4e7d-8c6b-d7322a69ee8a-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:18 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 1073741824" returned: 0 in 0.585s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:18 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 Sep 25 16:17:18 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "cinder-b3828a85-7fff-4179-96a9-959d54ad8a4a-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-b3828a85-7fff-4179-96a9-959d54ad8a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "cinder-quobyte-b3828a85-7fff-4179-96a9-959d54ad8a4a" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-b3828a85-7fff-4179-96a9-959d54ad8a4a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Deleting offline snapshot b3828a85-7fff-4179-96a9-959d54ad8a4a of volume 476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] snapshot_file for this snap is: volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-5dc033ae-ec0f-4154-926a-6d1409d8f8f4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7dbb9-1f4f-4b80-b212-e0993fba657e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:19 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-5dc033ae-ec0f-4154-926a-6d1409d8f8f4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8" returned: 0 in 0.465s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0c75de-89b3-4b16-b462-595508c51d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b767429-e098-498d-a4bf-ddb886be0ee8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f73be-2f29-42e3-b7cd-3e5fdfce4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Volume volume-7b767429-e098-498d-a4bf-ddb886be0ee8 (7b767429-e098-498d-a4bf-ddb886be0ee8): created successfully Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f73be-2f29-42e3-b7cd-3e5fdfce4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:19 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Flow 'volume_create_manager' (5c2b4a49-1550-4ad9-90b1-e2f86af2bca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:19 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-quobyte-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-79b7db89-4be9-48df-8dbf-b88fa7b99d96 tempest-GroupSnapshotsV319Test-42149439 None] Created volume successfully. Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fed672-d5c4-4acd-af03-929dda880968]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:19 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 Sep 25 16:17:19 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:19 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7058a2f1-ee75-4ad9-95e6-65f48625e976]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:19 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 Sep 25 16:17:19 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:19 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:20 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4 Sep 25 16:17:20 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:20 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" returned: 0 in 0.669s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:20 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" returned: 0 in 0.540s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:20 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a Sep 25 16:17:20 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-5dc033ae-ec0f-4154-926a-6d1409d8f8f4" released by "delete_volume" :: held 1.100s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Created reservations ['b8207b0f-71f8-48fb-85cf-70621192a633', '9d098674-02a4-40ea-b831-ee3e70837e7b', '8c4e2408-4c74-42b2-a067-8024285f301d', '5c66963b-6cff-41a0-a160-f1094b8ba447'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:20 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:20 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] GroupSnapshot 06570e07-1d9f-4279-84df-256b1242c61d: creating. Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Group snapshot 06570e07-1d9f-4279-84df-256b1242c61d: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Creating offline snapshot ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 of volume 7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e334c-3233-4c8d-8ce3-4b763546b3b1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:21 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a" returned: 0 in 0.669s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:21 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a Sep 25 16:17:21 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:21 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.499s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Deleted volume successfully. Sep 25 16:17:21 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 Sep 25 16:17:21 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7cf0afa5-0e20-498c-a736-4ce5432d2485 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-5dc033ae-ec0f-4154-926a-6d1409d8f8f4-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:21 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5.b3828a85-7fff-4179-96a9-959d54ad8a4a" returned: 0 in 0.432s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-aae9602c-a945-4502-84d5-819dc8e717d1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-b3828a85-7fff-4179-96a9-959d54ad8a4a" released by "_delete_snapshot" :: held 2.508s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" released by "delete_snapshot" :: held 2.554s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-aae9602c-a945-4502-84d5-819dc8e717d1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:21 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8" returned: 0 in 0.596s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:21 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 1G Sep 25 16:17:21 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "cinder-quobyte-aae9602c-a945-4502-84d5-819dc8e717d1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-aae9602c-a945-4502-84d5-819dc8e717d1" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Created reservations ['50d56c51-1940-4a6a-bf19-c76c9e65d32f', '4982c338-c315-48e2-932c-4b3b1d7dd589', 'ce814657-66d5-4bdd-99cb-885de1d36046', 'a57840f5-47b7-4e65-af01-a7328bb143f3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e5b5e-c740-4939-9951-816d83395b83]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Delete snapshot completed successfully. Sep 25 16:17:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1f5e487-a07d-4d47-b4dc-e7290d4f67b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-b3828a85-7fff-4179-96a9-959d54ad8a4a-delete_snapshot" released by "delete_snapshot" :: held 2.884s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:22 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 Sep 25 16:17:22 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 1G" returned: 0 in 0.582s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b767429-e098-498d-a4bf-ddb886be0ee8 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b767429-e098-498d-a4bf-ddb886be0ee8 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 Sep 25 16:17:22 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1" returned: 0 in 0.605s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1 Sep 25 16:17:22 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "cinder-476e91da-35f6-440c-a8c8-f6aa5da3ffe5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-476e91da-35f6-440c-a8c8-f6aa5da3ffe5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1629d0-51a2-45ae-b049-f88020fa2113]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b767429-e098-498d-a4bf-ddb886be0ee8 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" returned: 0 in 0.556s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 Sep 25 16:17:22 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 Sep 25 16:17:22 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aae9602c-a945-4502-84d5-819dc8e717d1" returned: 0 in 0.543s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-quobyte-aae9602c-a945-4502-84d5-819dc8e717d1" released by "delete_volume" :: held 1.232s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Created reservations ['2b786a12-20ff-4acb-a6ad-3b6879c96748', '035a00be-eb42-47d4-81fb-f7082428264e', '412036d7-f215-40cd-9dd1-c873f820b877', '48a09d7d-0f07-4e2d-be53-8f736db8661b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:23 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" returned: 0 in 0.448s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" returned: 0 in 0.558s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5 Sep 25 16:17:23 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info Sep 25 16:17:23 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.373s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Deleted volume successfully. Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-257a3579-d3af-42b5-a84a-d42f9e36ec54 tempest-CreateVolumesFromImageTest-1534751289 None] Lock "cinder-aae9602c-a945-4502-84d5-819dc8e717d1-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:23 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" returned: 0 in 0.418s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info Sep 25 16:17:23 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-quobyte-476e91da-35f6-440c-a8c8-f6aa5da3ffe5" released by "delete_volume" :: held 1.091s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Created reservations ['09abd098-cf2b-4f9b-85d8-c1a93df24362', '3cfaaa53-0903-40ba-ba49-1628abedb981', 'af39601e-9622-4a2b-9bce-0a05a0d56617', 'a835a70c-b68a-4c11-a220-5cf953bd75f9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:24 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:24 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:24 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.info" returned: 0 in 0.393s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e7d7dcf5-def5-4206-a5a3-004defcad1ec tempest-GroupSnapshotsV319Test-42149439 None] group_snapshot 06570e07-1d9f-4279-84df-256b1242c61d: created successfully Sep 25 16:17:24 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:24 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Deleted volume successfully. Sep 25 16:17:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-57133be2-37f0-4bce-8b7c-83521a4c478c tempest-VolumeSnapshotQuotasNegativeTestJSON-2125520150 None] Lock "cinder-476e91da-35f6-440c-a8c8-f6aa5da3ffe5-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] group_snapshot 06570e07-1d9f-4279-84df-256b1242c61d: deleting Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] group_snapshot 06570e07-1d9f-4279-84df-256b1242c61d: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "cinder-quobyte-ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Deleting offline snapshot ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 of volume 7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] snapshot_file for this snap is: volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a7397-2cae-470b-a342-f4de2fc63523]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:25 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 Sep 25 16:17:25 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:25 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" returned: 0 in 0.573s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b767429-e098-498d-a4bf-ddb886be0ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3982dae-0a00-4a12-940b-dd8e0171fd3b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:26 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 Sep 25 16:17:26 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:26 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:26 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 Sep 25 16:17:26 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:27 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:27 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007 Sep 25 16:17:27 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:27 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8.ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" returned: 0 in 0.402s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-ffe0b769-9f45-4596-a7e4-f3ed8c2bd007" released by "_delete_snapshot" :: held 2.405s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" released by "delete_snapshot" :: held 2.463s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:27 devstack cinder-volume[87199]: WARNING cinder.quota [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1369502805 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1369502805, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:27 devstack cinder-volume[87199]: WARNING cinder.quota [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1369502805 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1369502805, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] Created reservations ['58483d36-bc6f-4f9c-965f-bd81e725ac7d', 'd2b72993-564e-4fd4-aed2-1b5fd74a3304', 'ea88ba47-6384-4cbb-a38c-1a8c92f3521f', 'd7fa6e20-894f-4fa8-87f8-94033e055414'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-70a8a15c-70ce-4fde-86a1-9286d67441f8 tempest-GroupSnapshotsV319Test-42149439 None] group_snapshot 06570e07-1d9f-4279-84df-256b1242c61d: deleted successfully Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde70729-59eb-4193-9ce5-dcf35bd1eaac]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Flow 'volume_create_manager' (0dff346e-23d3-48fb-8c56-5f1d8beb2fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a12a96-be94-4c98-a16c-9caa5a8c1479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a12a96-be94-4c98-a16c-9caa5a8c1479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578646039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a11f09-a908-42f2-abf5-b5ad60648821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0232896cc19b4e978c3122ee00ea80c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:29Z,use_quota=True,user_id='8eddc2d2fa74458594d4d613133d2293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9447a198-dec8-4cae-945e-1c028c294ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9447a198-dec8-4cae-945e-1c028c294ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aabc4e-0c92-4230-bec1-bd9ab4d27649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aabc4e-0c92-4230-bec1-bd9ab4d27649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a11f09-a908-42f2-abf5-b5ad60648821', 'volume_name': 'volume-70a11f09-a908-42f2-abf5-b5ad60648821', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080d2301-dc8b-4160-939e-e294103148f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:29 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 Sep 25 16:17:29 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080d2301-dc8b-4160-939e-e294103148f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc7000f-ef62-426d-be8b-6405e1514159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Volume 70a11f09-a908-42f2-abf5-b5ad60648821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a11f09-a908-42f2-abf5-b5ad60648821', 'volume_size': 1} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578646039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a11f09-a908-42f2-abf5-b5ad60648821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0232896cc19b4e978c3122ee00ea80c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:29Z,use_quota=True,user_id='8eddc2d2fa74458594d4d613133d2293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Creating volume 70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:29 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:29 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 1073741824 Sep 25 16:17:29 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:30 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8" returned: 0 in 0.576s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:30 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8 Sep 25 16:17:30 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:30 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 1073741824" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:30 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7b767429-e098-498d-a4bf-ddb886be0ee8" returned: 0 in 0.418s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Lock "cinder-quobyte-7b767429-e098-498d-a4bf-ddb886be0ee8" released by "delete_volume" :: held 1.168s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:30 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:30 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Created reservations ['7cddd8cb-6916-4a46-a523-c7c5650d331d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:30 devstack cinder-volume[87199]: WARNING cinder.quota [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1369502805 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1369502805, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:30 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Created reservations ['ec69d38d-1a15-4f0b-8955-da737afdfe6d', '64b02032-0083-4f8e-80ba-a47101ec2190', '8a9ed472-0e73-47c6-a91a-13c211cdc2b6', '012c397a-8315-483a-851b-2c693792cd49'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:31 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.565s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:31 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:31 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc7000f-ef62-426d-be8b-6405e1514159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a11f09-a908-42f2-abf5-b5ad60648821', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db849ef0-a618-4eb9-b563-5b1d67ebe666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Volume volume-70a11f09-a908-42f2-abf5-b5ad60648821 (70a11f09-a908-42f2-abf5-b5ad60648821): created successfully Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db849ef0-a618-4eb9-b563-5b1d67ebe666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Flow 'volume_create_manager' (0dff346e-23d3-48fb-8c56-5f1d8beb2fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-feaed7d9-3267-4f5c-8bb4-2a7d2b2e7ab6 tempest-VolumeDependencyTests-353417764 None] Created volume successfully. Sep 25 16:17:31 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.373s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9178a8cc-84f2-45fa-ac00-6e67c521cfd9 tempest-GroupSnapshotsV319Test-42149439 None] Delete group completed successfully. Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Creating offline snapshot c007c905-165a-4a94-81ff-8f337d2e23b2 of volume 70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bebfd1-a152-411d-ba4d-973dc4a8769e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:31 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:31 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:32 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.532s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:32 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 1G Sep 25 16:17:32 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:32 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 1G" returned: 0 in 0.564s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11f09-a908-42f2-abf5-b5ad60648821 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:32 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11f09-a908-42f2-abf5-b5ad60648821 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:32 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:33 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11f09-a908-42f2-abf5-b5ad60648821 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.374s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:33 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 is being set with open permissions: ugo+rw Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:33 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:33 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:33 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.482s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=120,cinder:UPDATE=151,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=127,cinder:UPDATE=154,cinder:INSERT=36,cinder:DELETE=13 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:33 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info Sep 25 16:17:33 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:34 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info" returned: 0 in 0.537s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:34 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info is being set with open permissions: ugo+rw Sep 25 16:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:34 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info Sep 25 16:17:34 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:34 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.info" returned: 0 in 0.526s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-47904c3f-2e73-4b21-9910-8a96fa44bd13 tempest-VolumeDependencyTests-353417764 None] Create snapshot completed successfully Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Flow 'volume_create_manager' (e9b3dbe2-2e20-4cf3-803a-bdfe8013322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1a5d7-2c93-4b63-a4fa-1c7be301ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1a5d7-2c93-4b63-a4fa-1c7be301ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-336669163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0f542-4063-4cb5-9e98-f61f1cd7f823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0232896cc19b4e978c3122ee00ea80c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c007c905-165a-4a94-81ff-8f337d2e23b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:37Z,use_quota=True,user_id='8eddc2d2fa74458594d4d613133d2293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee51912-e442-401b-9c4b-af85a6b27fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee51912-e442-401b-9c4b-af85a6b27fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf66d117-0851-46e4-b543-f8ef84f17bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf66d117-0851-46e4-b543-f8ef84f17bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5bd0f542-4063-4cb5-9e98-f61f1cd7f823', 'volume_name': 'volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823', 'volume_size': 1, 'snapshot_id': 'c007c905-165a-4a94-81ff-8f337d2e23b2'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0a034c-0cd4-4f8a-9413-411154098480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0a034c-0cd4-4f8a-9413-411154098480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48fcfa9-02d4-4dbf-be6b-cab0fe2e43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Volume 5bd0f542-4063-4cb5-9e98-f61f1cd7f823: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823', 'volume_size': 1, 'snapshot_id': 'c007c905-165a-4a94-81ff-8f337d2e23b2'} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Creating volume 5bd0f542-4063-4cb5-9e98-f61f1cd7f823 from snapshot c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] snapshot: c007c905-165a-4a94-81ff-8f337d2e23b2, volume: 5bd0f542-4063-4cb5-9e98-f61f1cd7f823, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcf3f35-2b8b-491a-a2ec-156f3f2c181c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:37 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:37 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:38 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.597s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a11f09-a908-42f2-abf5-b5ad60648821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8510b97-b302-4d39-b1e5-ea44d16085f2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:38 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:38 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:38 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.503s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:38 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 Sep 25 16:17:38 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-349f460b-8643-4ab9-83f9-c62a83bd93ad tempest-GroupsV320Test-1987253670 None] Group tempest-GroupsV320Test-Group-1968939538: creating Sep 25 16:17:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-349f460b-8643-4ab9-83f9-c62a83bd93ad tempest-GroupsV320Test-1987253670 None] Group tempest-GroupsV320Test-Group-1968939538: created successfully Sep 25 16:17:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-349f460b-8643-4ab9-83f9-c62a83bd93ad tempest-GroupsV320Test-1987253670 None] Create group completed successfully. Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Created reservations ['4eaf06b4-6706-4be0-8924-61e8105fec70'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:46 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:46 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:46 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.541s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e5a2505d-0d96-4893-9fe6-38295ef2571d tempest-GroupsV320Test-1987253670 None] Delete group completed successfully. Sep 25 16:17:47 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" returned: 0 in 9.055s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:47 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:17:47 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Converted 1024.00 MB image at 113.08 MB/s Sep 25 16:17:47 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 is being set with open permissions: ugo+rw Sep 25 16:17:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:47 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 Sep 25 16:17:47 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:48 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" released by "_copy_volume_from_snapshot" :: held 10.677s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" released by "_create_volume_from_snapshot" :: held 10.770s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.794s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48fcfa9-02d4-4dbf-be6b-cab0fe2e43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823', 'volume_size': 1, 'snapshot_id': 'c007c905-165a-4a94-81ff-8f337d2e23b2'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2574f3-2d6f-4203-a354-fee28a01f924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Volume volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 (5bd0f542-4063-4cb5-9e98-f61f1cd7f823): created successfully Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2574f3-2d6f-4203-a354-fee28a01f924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Flow 'volume_create_manager' (e9b3dbe2-2e20-4cf3-803a-bdfe8013322b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-df43437b-ec89-4e7d-863e-906ff85c2f2c tempest-VolumeDependencyTests-353417764 None] Created volume successfully. Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-c007c905-165a-4a94-81ff-8f337d2e23b2-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-c007c905-165a-4a94-81ff-8f337d2e23b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Deleting offline snapshot c007c905-165a-4a94-81ff-8f337d2e23b2 of volume 70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] snapshot_file for this snap is: volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43bd8c2-e231-48f2-8ddd-7f0e973b74bc]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:49 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:49 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:49 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.488s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a11f09-a908-42f2-abf5-b5ad60648821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8a53d-d7d3-4e3a-9940-e74c8854a029]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:49 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:49 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:50 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:50 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:50 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:50 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.486s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:50 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2 Sep 25 16:17:50 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:51 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821.c007c905-165a-4a94-81ff-8f337d2e23b2" returned: 0 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-c007c905-165a-4a94-81ff-8f337d2e23b2" released by "_delete_snapshot" :: held 2.170s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" released by "delete_snapshot" :: held 2.200s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Created reservations ['2572ed62-f69f-46ef-9abd-f8e8d0e6eb4e', '3f331ad1-ac9f-4f4d-9b88-73c3a0f7f39a', '8975ba70-1754-40d6-b6e9-9ec35892de4c', 'e56a0031-109f-4d99-88e2-cf52fd8018be'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Delete snapshot completed successfully. Sep 25 16:17:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92fa1ae-4b13-4b86-9c41-23358bd31b0d tempest-VolumeDependencyTests-353417764 None] Lock "cinder-c007c905-165a-4a94-81ff-8f337d2e23b2-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-70a11f09-a908-42f2-abf5-b5ad60648821-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-70a11f09-a908-42f2-abf5-b5ad60648821-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e673f-444a-4fd3-a03f-4bc7172d47fb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:52 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:52 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:52 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.430s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:52 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821 Sep 25 16:17:52 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:53 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70a11f09-a908-42f2-abf5-b5ad60648821" returned: 0 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-70a11f09-a908-42f2-abf5-b5ad60648821" released by "delete_volume" :: held 0.899s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Created reservations ['f7874d4b-9431-4b86-80d6-dfa7bf4248e4', '35000466-6a00-4b21-892d-684e26a18ab0', '0219a7f1-fbb3-4e98-8db9-3ec004764362', '998bb675-80a6-405e-9244-4c8599cf60f8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:53 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:53 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-5bd0f542-4063-4cb5-9e98-f61f1cd7f823-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-5bd0f542-4063-4cb5-9e98-f61f1cd7f823-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38495a8-70ea-4265-9657-3b938af1e9e4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:53 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.481s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Deleted volume successfully. Sep 25 16:17:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-712e0d9a-5e2e-45fb-90ee-9d642aef9880 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-70a11f09-a908-42f2-abf5-b5ad60648821-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:53 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 Sep 25 16:17:53 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:54 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" returned: 0 in 0.552s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:54 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823 Sep 25 16:17:54 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:54 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-quobyte-5bd0f542-4063-4cb5-9e98-f61f1cd7f823" released by "delete_volume" :: held 1.020s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Created reservations ['25a0d368-5642-4a7d-9083-a33809a9168a', '51f4b234-dd6c-463b-8345-d901e54396f2', '25eb5360-16a8-4505-ae78-1cad17cb9c66', '45d16acb-185a-40c2-853b-c104530a6b34'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:54 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:17:54 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (60b7812a-c021-46be-b6d1-97a6825a0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df3236-cf33-47f8-bff7-f502a1133b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df3236-cf33-47f8-bff7-f502a1133b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-42911719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4380bbd1-29b6-4ac2-ab30-7256f7d6b19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b97019a960444af83bdf9adee4b0362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:55Z,use_quota=True,user_id='e962642b05dd41ac91cbc6e574c86b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552422e3-db47-492c-9ddf-3acb76948b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552422e3-db47-492c-9ddf-3acb76948b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a2360f-1d1d-4f6d-b214-98336c856b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a2360f-1d1d-4f6d-b214-98336c856b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4380bbd1-29b6-4ac2-ab30-7256f7d6b19e', 'volume_name': 'volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069cad4b-44a2-4199-9c1b-76b37355ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069cad4b-44a2-4199-9c1b-76b37355ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50ea68c-2b52-47d0-a10b-a1cb5c2c6bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e', 'volume_size': 1} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-42911719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4380bbd1-29b6-4ac2-ab30-7256f7d6b19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b97019a960444af83bdf9adee4b0362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:55Z,use_quota=True,user_id='e962642b05dd41ac91cbc6e574c86b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Creating volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:55 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e 1073741824 Sep 25 16:17:55 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:55 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Deleted volume successfully. Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-55dd7c39-714f-4a25-906e-ba4a201c8129 tempest-VolumeDependencyTests-353417764 None] Lock "cinder-5bd0f542-4063-4cb5-9e98-f61f1cd7f823-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:55 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e 1073741824" returned: 0 in 0.532s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:55 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e Sep 25 16:17:55 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:56 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50ea68c-2b52-47d0-a10b-a1cb5c2c6bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73b52d5-5110-4e3d-9660-f9a9c9f76f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Volume volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e (4380bbd1-29b6-4ac2-ab30-7256f7d6b19e): created successfully Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73b52d5-5110-4e3d-9660-f9a9c9f76f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (60b7812a-c021-46be-b6d1-97a6825a0a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-442abde0-c4f7-4232-a221-07eab98b7743 tempest-VolumesDeleteCascade-1145924126 None] Created volume successfully. Sep 25 16:17:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Creating offline snapshot f89d085d-bf22-4252-8ed3-16f170d28d9c of volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c4722-f307-4abc-b854-4b32e2f66049]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:57 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e Sep 25 16:17:57 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:58 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" returned: 0 in 0.642s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:58 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c 1G Sep 25 16:17:58 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:58 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c 1G" returned: 0 in 0.721s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:58 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:17:58 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:59 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.446s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:59 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c is being set with open permissions: ugo+rw Sep 25 16:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:59 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:17:59 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:59 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:59 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info Sep 25 16:17:59 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:00 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info" returned: 0 in 0.537s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info is being set with open permissions: ugo+rw Sep 25 16:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:00 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info Sep 25 16:18:00 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:00 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.info" returned: 0 in 0.549s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.431s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cba59d7e-6cb7-4bb8-8053-f9d7ccc86cfe tempest-VolumesDeleteCascade-1145924126 None] Create snapshot completed successfully Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Creating offline snapshot d74583b6-32b7-4087-a373-c6fddeae4e87 of volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a9108-7310-49b9-a73b-2d3d0eed6597]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5c1a5383-790f-4e44-ba6e-1d90973e573b req-f53bbbd6-c182-4586-8d4a-b1ba87b866b4 tempest-TestMinimumBasicScenario-618995918 None] Terminate volume connection completed successfully. Sep 25 16:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5c1a5383-790f-4e44-ba6e-1d90973e573b req-f53bbbd6-c182-4586-8d4a-b1ba87b866b4 tempest-TestMinimumBasicScenario-618995918 None] Deleting attachment fe744d73-f70a-422c-b159-06ed1ace1d90. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:18:02 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:18:02 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:03 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:03 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 1G Sep 25 16:18:03 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:03 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 1G" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:03 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 Sep 25 16:18:03 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "cinder-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "cinder-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "cinder-quobyte-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "cinder-quobyte-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[329483f5-5824-42f8-9da7-1a9efc27fbec]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:04 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 Sep 25 16:18:04 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:04 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87" returned: 0 in 0.561s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:04 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 is being set with open permissions: ugo+rw Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:04 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 Sep 25 16:18:04 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:04 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" returned: 0 in 0.554s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:04 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16 Sep 25 16:18:04 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:04 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-56080752-ec38-4e40-b976-5b1c168180ec tempest-VolumesDeleteCascade-1145924126 None] Create snapshot completed successfully Sep 25 16:18:05 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" returned: 0 in 0.443s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "cinder-quobyte-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16" released by "delete_volume" :: held 1.071s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Created reservations ['99999b22-9e33-4504-af40-b5abe5c7f1cf', '56eb6302-b417-4e5a-b160-c940b4663db8', '60578ca5-bc4f-4d26-8236-2de70d13a03a', '9b425151-78d1-4178-899b-80c4e0d324b9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:05 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:05 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:05 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Performing cascade delete. {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Deleted volume successfully. Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-d74583b6-32b7-4087-a373-c6fddeae4e87-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e173772-ce2d-423f-bd59-60b2f2408d95 tempest-TestMinimumBasicScenario-618995918 None] Lock "cinder-50c03c98-cba8-4c9f-bc7a-70e6ffc17c16-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-d74583b6-32b7-4087-a373-c6fddeae4e87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-d74583b6-32b7-4087-a373-c6fddeae4e87" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-d74583b6-32b7-4087-a373-c6fddeae4e87" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Deleting offline snapshot d74583b6-32b7-4087-a373-c6fddeae4e87 of volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] snapshot_file for this snap is: volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b414463-3966-4ca9-8557-262f92e02fb6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:05 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 Sep 25 16:18:05 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:06 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:06 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:06 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87" returned: 0 in 0.620s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[20694a45-a492-428f-977b-585135c82437]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:06 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.595s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:18:06 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:18:06 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:07 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.818s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:07 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 Sep 25 16:18:07 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:07 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87" returned: 0 in 0.620s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:08 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87 Sep 25 16:18:08 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:08 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.d74583b6-32b7-4087-a373-c6fddeae4e87" returned: 0 in 0.592s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-d74583b6-32b7-4087-a373-c6fddeae4e87" released by "_delete_snapshot" :: held 2.830s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" released by "delete_snapshot" :: held 2.873s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['1cea6580-8a35-4cfc-9b8a-0f53426f5ead', '15a4c9f2-bc84-4ca7-b00f-52b490342832', '4f627cee-35cf-4880-969e-71ca364194ec', 'd9fd85ee-997d-4f80-9d21-703659e0049b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Delete snapshot completed successfully. Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-d74583b6-32b7-4087-a373-c6fddeae4e87-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-f89d085d-bf22-4252-8ed3-16f170d28d9c-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-f89d085d-bf22-4252-8ed3-16f170d28d9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-f89d085d-bf22-4252-8ed3-16f170d28d9c" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-f89d085d-bf22-4252-8ed3-16f170d28d9c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Deleting offline snapshot f89d085d-bf22-4252-8ed3-16f170d28d9c of volume 4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] snapshot_file for this snap is: volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb8b251-c691-4d69-be7b-811f1860f7b6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:09 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:18:09 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:09 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecd27ba-119e-4a16-9115-099c3c7b1954]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:10 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e Sep 25 16:18:10 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:10 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" returned: 0 in 0.608s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:10 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:18:10 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:10 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.549s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:10 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c Sep 25 16:18:10 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:11 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e.f89d085d-bf22-4252-8ed3-16f170d28d9c" returned: 0 in 0.444s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-f89d085d-bf22-4252-8ed3-16f170d28d9c" released by "_delete_snapshot" :: held 2.323s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" released by "delete_snapshot" :: held 2.359s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['9aa1c9cd-5baf-41b4-8694-925537825ca6', '7fc7a5bd-fddc-4e3c-99ed-ebb4aea9dc3c', '7d7b6be9-8e3b-491a-bdd7-2b7d883eedcc', '78784873-47ba-46fd-9118-72cc3f10844f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Delete snapshot completed successfully. Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-f89d085d-bf22-4252-8ed3-16f170d28d9c-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Snapshots deleted, issuing volume delete {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" acquired by "delete_volume" :: waited 0.050s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7305b2-f668-483a-b04b-14ebd052800e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:11 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e Sep 25 16:18:11 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:12 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" returned: 0 in 0.479s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:12 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e Sep 25 16:18:12 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:12 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" returned: 0 in 0.428s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e" released by "delete_volume" :: held 1.039s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['d5e1a705-a6ee-4e1e-be4e-8978f55b44c1', 'c4066ce0-f390-42c8-aacd-4c7a216e9f0a', '0d48d151-2eec-4b94-9af7-41315a905d1b', 'ed7ba552-da8f-47f5-b3bc-88a5f096523f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:13 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:13 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:13 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Deleted volume successfully. Sep 25 16:18:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-942f056d-f4c9-42e7-b6cc-6b4cfb1b4402 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-4380bbd1-29b6-4ac2-ab30-7256f7d6b19e-delete_volume" released by "delete_volume" :: held 7.769s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (c7cec3d8-05d7-443a-afca-c88e97da0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc80977-2f8c-438d-a2ff-4c16517afd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc80977-2f8c-438d-a2ff-4c16517afd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-282798131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4b5900-fbec-491c-9ba5-744d226c2ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b97019a960444af83bdf9adee4b0362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:15Z,use_quota=True,user_id='e962642b05dd41ac91cbc6e574c86b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5c2e25-35d5-4b93-880a-ec064ea26c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5c2e25-35d5-4b93-880a-ec064ea26c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6896281-f55c-4e2f-a1de-8400b37e8811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6896281-f55c-4e2f-a1de-8400b37e8811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4b5900-fbec-491c-9ba5-744d226c2ff2', 'volume_name': 'volume-de4b5900-fbec-491c-9ba5-744d226c2ff2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cbfa22-1816-4a86-8c50-66564d666823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cbfa22-1816-4a86-8c50-66564d666823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d47bb7c-a1b1-4c9c-844b-cac83abfa03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Volume de4b5900-fbec-491c-9ba5-744d226c2ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4b5900-fbec-491c-9ba5-744d226c2ff2', 'volume_size': 1} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-282798131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4b5900-fbec-491c-9ba5-744d226c2ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b97019a960444af83bdf9adee4b0362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:15Z,use_quota=True,user_id='e962642b05dd41ac91cbc6e574c86b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Creating volume de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:14 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:15 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 1073741824 Sep 25 16:18:15 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:15 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 1073741824" returned: 0 in 0.702s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:15 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:15 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:16 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d47bb7c-a1b1-4c9c-844b-cac83abfa03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4b5900-fbec-491c-9ba5-744d226c2ff2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5547e7-1e1e-47a4-a948-770355ee0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Volume volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 (de4b5900-fbec-491c-9ba5-744d226c2ff2): created successfully Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5547e7-1e1e-47a4-a948-770355ee0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (c7cec3d8-05d7-443a-afca-c88e97da0426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a47af691-e44d-4513-850a-8732fbd1fdae tempest-VolumesDeleteCascade-1145924126 None] Created volume successfully. Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Creating offline snapshot 565f92a3-b8d8-48a0-8758-8d9ce0830db5 of volume de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c46718-dbea-4483-a21d-c007b5488c21]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:17 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:17 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:17 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:17 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 1G Sep 25 16:18:17 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:18 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 1G" returned: 0 in 0.603s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:18 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:18 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:18 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.534s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:18 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 is being set with open permissions: ugo+rw Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:18 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:18 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Flow 'volume_create_manager' (98a4809a-a170-4264-9215-2f00415cd6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80070a2-7c4c-4800-b068-507904acc0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80070a2-7c4c-4800-b068-507904acc0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-672909469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d26c001be04bdf8bf3e33fa5be7e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='ab5b33690e624aab90cc7e463a40bb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02dce67-8fda-4fa7-ba13-6eefe4091278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02dce67-8fda-4fa7-ba13-6eefe4091278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59c0e90-f425-4183-8b45-e880be292ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59c0e90-f425-4183-8b45-e880be292ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22', 'volume_name': 'volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3455bf-1803-49ef-8323-eda88f69de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3455bf-1803-49ef-8323-eda88f69de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e87d46-a23b-4d95-9256-6c721d560cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Volume f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22', 'volume_size': 1} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:19 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.306s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:19 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info Sep 25 16:18:19 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:19 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info" returned: 0 in 0.298s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:19 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info is being set with open permissions: ugo+rw Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:19 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info Sep 25 16:18:19 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:19 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.info" returned: 0 in 0.315s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-672909469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d26c001be04bdf8bf3e33fa5be7e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='ab5b33690e624aab90cc7e463a40bb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Creating volume f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:18:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:19 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 1073741824 Sep 25 16:18:19 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-27bbd3a5-0dc6-4e64-a5ad-008ee99e90eb tempest-VolumesDeleteCascade-1145924126 None] Create snapshot completed successfully Sep 25 16:18:20 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 1073741824" returned: 0 in 0.595s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:20 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 Sep 25 16:18:20 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:20 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e87d46-a23b-4d95-9256-6c721d560cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017981a9-573c-451f-be33-1981821605cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Volume volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 (f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22): created successfully Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017981a9-573c-451f-be33-1981821605cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Flow 'volume_create_manager' (98a4809a-a170-4264-9215-2f00415cd6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d8a52d78-45d5-4336-934b-55742d4f37d8 tempest-VolumeQuotasNegativeTestJSON-643081369 None] Created volume successfully. Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (c0d4790a-f920-4769-b4af-6472c6c4fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df12acd-b7a7-46aa-bff9-e43b2fa6f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df12acd-b7a7-46aa-bff9-e43b2fa6f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1553358571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc68f84-77c9-4810-8de8-b38e09e90e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b97019a960444af83bdf9adee4b0362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=565f92a3-b8d8-48a0-8758-8d9ce0830db5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:21Z,use_quota=True,user_id='e962642b05dd41ac91cbc6e574c86b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be263fcc-ad2b-4eca-aafb-efa10e1f7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be263fcc-ad2b-4eca-aafb-efa10e1f7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e4bc03-fc0c-4096-ad6e-7ee55359fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e4bc03-fc0c-4096-ad6e-7ee55359fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fc68f84-77c9-4810-8de8-b38e09e90e0b', 'volume_name': 'volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b', 'volume_size': 1, 'snapshot_id': '565f92a3-b8d8-48a0-8758-8d9ce0830db5'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f93a55-1c26-4d7d-bd82-cd960e7c0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f93a55-1c26-4d7d-bd82-cd960e7c0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c226be83-4948-40a4-8f39-0c59a1b77011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Volume 7fc68f84-77c9-4810-8de8-b38e09e90e0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b', 'volume_size': 1, 'snapshot_id': '565f92a3-b8d8-48a0-8758-8d9ce0830db5'} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5-7fc68f84-77c9-4810-8de8-b38e09e90e0b" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5-7fc68f84-77c9-4810-8de8-b38e09e90e0b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Creating volume 7fc68f84-77c9-4810-8de8-b38e09e90e0b from snapshot 565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] snapshot: 565f92a3-b8d8-48a0-8758-8d9ce0830db5, volume: 7fc68f84-77c9-4810-8de8-b38e09e90e0b, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b2974e-9fc2-4321-a11d-c5e944c0d9cb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:21 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:21 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:21 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.507s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4b5900-fbec-491c-9ba5-744d226c2ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b77317-5154-4a33-bde2-cdb3a37394fa]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:22 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:22 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Acquiring lock "cinder-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "cinder-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Acquiring lock "cinder-quobyte-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "cinder-quobyte-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff03d7a-3826-496b-91e6-af6281bf28c6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:22 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.621s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:22 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b Sep 25 16:18:22 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:22 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 Sep 25 16:18:22 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:23 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" returned: 0 in 0.533s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:23 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22 Sep 25 16:18:23 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:23 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" returned: 0 in 0.395s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "cinder-quobyte-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22" released by "delete_volume" :: held 1.004s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Created reservations ['cf6e1db3-fac3-494a-ac64-68cafd1f7b23', 'd9e3453b-de4e-4d3e-93f2-bb7307c83d96', '37a8dd33-d812-49f2-89a1-cd0b9f7d13f5', 'c623601d-5582-49ac-be17-f322853aea0f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:24 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:24 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:24 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:24 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Deleted volume successfully. Sep 25 16:18:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3db16aa5-3b44-43f3-a03b-f002db1c34ba tempest-VolumeQuotasNegativeTestJSON-643081369 None] Lock "cinder-f0d5c2d0-f4f3-4724-b8da-d8e3bdc5bf22-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:31 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b" returned: 0 in 8.398s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:18:31 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Converted 1024.00 MB image at 121.92 MB/s Sep 25 16:18:31 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b is being set with open permissions: ugo+rw Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:31 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b Sep 25 16:18:31 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:31 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b" returned: 0 in 0.349s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" released by "_copy_volume_from_snapshot" :: held 10.013s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5-7fc68f84-77c9-4810-8de8-b38e09e90e0b" released by "_create_volume_from_snapshot" :: held 10.113s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.134s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c226be83-4948-40a4-8f39-0c59a1b77011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b', 'volume_size': 1, 'snapshot_id': '565f92a3-b8d8-48a0-8758-8d9ce0830db5'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca40a8aa-c1b3-4b60-89d6-ee1fdb3b39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Volume volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b (7fc68f84-77c9-4810-8de8-b38e09e90e0b): created successfully Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca40a8aa-c1b3-4b60-89d6-ee1fdb3b39ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Flow 'volume_create_manager' (c0d4790a-f920-4769-b4af-6472c6c4fb56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-adee74c5-6a67-418a-9fb9-8b3e644aa18d tempest-VolumesDeleteCascade-1145924126 None] Created volume successfully. Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-de4b5900-fbec-491c-9ba5-744d226c2ff2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-de4b5900-fbec-491c-9ba5-744d226c2ff2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Performing cascade delete. {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-565f92a3-b8d8-48a0-8758-8d9ce0830db5-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-565f92a3-b8d8-48a0-8758-8d9ce0830db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Deleting offline snapshot 565f92a3-b8d8-48a0-8758-8d9ce0830db5 of volume de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] snapshot_file for this snap is: volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba4875-4278-4621-b4f4-99ad15554553]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:32 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:32 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:33 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4b5900-fbec-491c-9ba5-744d226c2ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19dc214-d259-41de-b973-dd80180dddc4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:33 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:33 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:34 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:34 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.510s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:34 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5 Sep 25 16:18:34 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2.565f92a3-b8d8-48a0-8758-8d9ce0830db5" returned: 0 in 0.381s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-565f92a3-b8d8-48a0-8758-8d9ce0830db5" released by "_delete_snapshot" :: held 2.318s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" released by "delete_snapshot" :: held 2.355s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=85,cinder:DELETE=6,cinder:SELECT=63,cinder:INSERT=21 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=88,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['646290d8-1558-4ba9-914c-0655fa61d23c', '361c244d-3b52-44cd-9c60-97cc28c71160', '1da5b45c-aa2b-42d0-855b-df143d5ee2a9', '2697c74e-8e92-45dd-a2ba-3d48f2e28ce8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Delete snapshot completed successfully. Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-565f92a3-b8d8-48a0-8758-8d9ce0830db5-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Snapshots deleted, issuing volume delete {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c40c4ca-2fcc-49e8-b515-cf4d229786dc]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:35 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:35 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:35 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.574s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:36 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2 Sep 25 16:18:36 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Flow 'volume_create_manager' (018663eb-edf3-4221-ad42-0d2d7e4343d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f8d84-9e7e-40c9-8ad4-c05f68d02795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f8d84-9e7e-40c9-8ad4-c05f68d02795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1061452160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e9882d-416c-427a-b785-b4ba5a899e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051fa904b69949a5a2b93bbb2270f226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:36Z,use_quota=True,user_id='41cfc04ffba749bda2b399c5c4f4b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca12bfd7-472e-4b39-8f0a-746b326012c4),volume_type_id=ca12bfd7-472e-4b39-8f0a-746b326012c4)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f7e7e0-09fc-41df-a324-ccdd6ef94a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f7e7e0-09fc-41df-a324-ccdd6ef94a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccf3549-3ddc-4951-a486-3a4cfd2dcb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccf3549-3ddc-4951-a486-3a4cfd2dcb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e9882d-416c-427a-b785-b4ba5a899e1e', 'volume_name': 'volume-e0e9882d-416c-427a-b785-b4ba5a899e1e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd38d6c0-88fd-40e6-8290-6edc61e14792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd38d6c0-88fd-40e6-8290-6edc61e14792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e39b01-199f-4d73-9afa-93447bc78cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Volume e0e9882d-416c-427a-b785-b4ba5a899e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e9882d-416c-427a-b785-b4ba5a899e1e', 'volume_size': 1} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1061452160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e9882d-416c-427a-b785-b4ba5a899e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051fa904b69949a5a2b93bbb2270f226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:36Z,use_quota=True,user_id='41cfc04ffba749bda2b399c5c4f4b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca12bfd7-472e-4b39-8f0a-746b326012c4),volume_type_id=ca12bfd7-472e-4b39-8f0a-746b326012c4)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Creating volume e0e9882d-416c-427a-b785-b4ba5a899e1e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:36 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-de4b5900-fbec-491c-9ba5-744d226c2ff2" returned: 0 in 0.457s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:36 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e 1073741824 Sep 25 16:18:36 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-de4b5900-fbec-491c-9ba5-744d226c2ff2" released by "delete_volume" :: held 1.141s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['2fe24852-4fb1-4d45-899f-4f011f6a39b0', '41d35c3c-9aa6-4b3d-9af7-efc7e93d16f1', '7d1d4a68-28d5-47a4-a6a9-ac316cbac210', 'fbc32327-a686-4e23-a66e-11ce60a5af8e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:36 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:36 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:37 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Deleted volume successfully. Sep 25 16:18:37 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e 1073741824" returned: 0 in 0.624s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45091b9a-0cf5-4281-993b-c1cdbafd21c9 tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-de4b5900-fbec-491c-9ba5-744d226c2ff2-delete_volume" released by "delete_volume" :: held 4.505s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e Sep 25 16:18:37 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-7fc68f84-77c9-4810-8de8-b38e09e90e0b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-7fc68f84-77c9-4810-8de8-b38e09e90e0b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7cea7c-e41e-4c64-b905-b27917be522e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e39b01-199f-4d73-9afa-93447bc78cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e9882d-416c-427a-b785-b4ba5a899e1e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:37 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b Sep 25 16:18:37 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f49bfcb-a2ae-455f-bf81-7305574a074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Volume volume-e0e9882d-416c-427a-b785-b4ba5a899e1e (e0e9882d-416c-427a-b785-b4ba5a899e1e): created successfully Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f49bfcb-a2ae-455f-bf81-7305574a074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Flow 'volume_create_manager' (018663eb-edf3-4221-ad42-0d2d7e4343d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c87c056a-e3ac-4994-85c3-fcbdf4f43b26 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Created volume successfully. Sep 25 16:18:37 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b" returned: 0 in 0.471s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b Sep 25 16:18:37 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7fc68f84-77c9-4810-8de8-b38e09e90e0b" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-quobyte-7fc68f84-77c9-4810-8de8-b38e09e90e0b" released by "delete_volume" :: held 0.802s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Created reservations ['06e640d3-a221-40d3-98ad-eaf53420dd50', '4550d372-d9ec-42e0-94c5-9a8058242a75', '3e70fbdd-8fe2-4f69-972a-ac9f3bfb3a34', 'ed10a960-ee01-4a7c-b0d8-53c877fbdfad'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:38 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:38 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.304s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Deleted volume successfully. Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-16390bfb-10d0-4227-9351-3f14032ee34b tempest-VolumesDeleteCascade-1145924126 None] Lock "cinder-7fc68f84-77c9-4810-8de8-b38e09e90e0b-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:38 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:38 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:39 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.344s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:39 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-712f4714-8028-4a6e-99dc-5aaf8f1fbfc5 tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Retype volume completed successfully. Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "cinder-e0e9882d-416c-427a-b785-b4ba5a899e1e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "cinder-e0e9882d-416c-427a-b785-b4ba5a899e1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "cinder-quobyte-e0e9882d-416c-427a-b785-b4ba5a899e1e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "cinder-quobyte-e0e9882d-416c-427a-b785-b4ba5a899e1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eabd4dd-79b9-4aa2-9cd8-a01611ab76c4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e Sep 25 16:18:40 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:40 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e" returned: 0 in 0.526s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e Sep 25 16:18:40 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:41 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e0e9882d-416c-427a-b785-b4ba5a899e1e" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "cinder-quobyte-e0e9882d-416c-427a-b785-b4ba5a899e1e" released by "delete_volume" :: held 0.884s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:41 devstack cinder-volume[87199]: WARNING cinder.quota [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:41 devstack cinder-volume[87199]: WARNING cinder.quota [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Created reservations ['42910c41-7b15-4ed6-ac56-086c6ec80428', 'e4a47422-e6fc-4701-bebf-36ff8fc43dc1', '4717959f-6ac2-4f17-892d-a30b8245d6cf', 'fbaca810-1e51-4cfe-8c74-22a3d43ca234'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:41 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:41 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:41 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Deleted volume successfully. Sep 25 16:18:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-10bdf31d-4e8f-460e-be6d-14fd4a66120b tempest-VolumeRetypeWithoutMigrationTest-1948748268 None] Lock "cinder-e0e9882d-416c-427a-b785-b4ba5a899e1e-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Flow 'volume_create_manager' (18add467-fb4d-42de-aa9b-f3916fe64fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e8d76f-d90e-434b-b9d6-967bd809e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e8d76f-d90e-434b-b9d6-967bd809e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-928410244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21066175-048a-41f2-8bf3-56e7843caefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8fc06af008415ea708c72013558ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:47Z,use_quota=True,user_id='aac136afa22346e8a970728bc18b47e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8266f-889c-4670-a350-46f9bab5ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8266f-889c-4670-a350-46f9bab5ee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6994644c-b66e-43fa-a428-3bd465573fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6994644c-b66e-43fa-a428-3bd465573fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21066175-048a-41f2-8bf3-56e7843caefa', 'volume_name': 'volume-21066175-048a-41f2-8bf3-56e7843caefa', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a28fad3-4855-4bb3-b2dc-57a8c8150933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a28fad3-4855-4bb3-b2dc-57a8c8150933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0987d2-41aa-4d94-af42-6ed7c58aaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Volume 21066175-048a-41f2-8bf3-56e7843caefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21066175-048a-41f2-8bf3-56e7843caefa', 'volume_size': 1} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-928410244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21066175-048a-41f2-8bf3-56e7843caefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8fc06af008415ea708c72013558ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:47Z,use_quota=True,user_id='aac136afa22346e8a970728bc18b47e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Creating volume 21066175-048a-41f2-8bf3-56e7843caefa {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:46 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:46 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa 1073741824 Sep 25 16:18:46 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:47 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa 1073741824" returned: 0 in 0.591s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:47 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa Sep 25 16:18:47 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:47 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa" returned: 0 in 0.361s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0987d2-41aa-4d94-af42-6ed7c58aaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21066175-048a-41f2-8bf3-56e7843caefa', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbeca82a-80ff-4832-ab5a-08816fa33285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Volume volume-21066175-048a-41f2-8bf3-56e7843caefa (21066175-048a-41f2-8bf3-56e7843caefa): created successfully Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbeca82a-80ff-4832-ab5a-08816fa33285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Flow 'volume_create_manager' (18add467-fb4d-42de-aa9b-f3916fe64fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-68b12bb6-1757-43f0-ac66-b1f59a47af8f tempest-VolumesTransfersTest-524882166 None] Created volume successfully. Sep 25 16:18:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd729b09-fdb8-455b-a8d8-0938c73e37f6 tempest-VolumesTransfersTest-617744316 None] Transfer volume completed successfully. Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Acquiring lock "cinder-21066175-048a-41f2-8bf3-56e7843caefa-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "cinder-21066175-048a-41f2-8bf3-56e7843caefa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Acquiring lock "cinder-quobyte-21066175-048a-41f2-8bf3-56e7843caefa" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "cinder-quobyte-21066175-048a-41f2-8bf3-56e7843caefa" acquired by "delete_volume" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb64374-be02-4beb-a6bf-c2465be4386e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:51 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa Sep 25 16:18:51 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:51 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa" returned: 0 in 0.471s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:51 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa Sep 25 16:18:51 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:51 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21066175-048a-41f2-8bf3-56e7843caefa" returned: 0 in 0.423s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "cinder-quobyte-21066175-048a-41f2-8bf3-56e7843caefa" released by "delete_volume" :: held 0.967s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Created reservations ['acb069ce-42d5-4262-b552-22f1d3781f42', 'bc61dec7-fc8f-41bb-99a2-d9b9ee36f309', '93f1277f-ee5a-4578-a621-3294f3f18a94', '40a0d42e-9ce1-41c2-9f9f-3b62c59cd027'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:52 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:52 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:52 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Deleted volume successfully. Sep 25 16:18:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3a022fa9-a4ff-4720-baad-1e1c9bda04cc tempest-VolumesTransfersTest-850971566 None] Lock "cinder-21066175-048a-41f2-8bf3-56e7843caefa-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Flow 'volume_create_manager' (487e9349-6255-42b6-b21e-5e3542fa0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b7cdc-f633-4711-93ec-433dfaf7630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b7cdc-f633-4711-93ec-433dfaf7630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-445046740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e557f1-d022-4174-af7a-a41b85a3213e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8fc06af008415ea708c72013558ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:54Z,use_quota=True,user_id='aac136afa22346e8a970728bc18b47e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd186d29-a900-4af0-ab80-619ff89eaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd186d29-a900-4af0-ab80-619ff89eaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097c218f-a1c2-4ef9-a04e-dcd6c5dcd1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097c218f-a1c2-4ef9-a04e-dcd6c5dcd1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e557f1-d022-4174-af7a-a41b85a3213e', 'volume_name': 'volume-f2e557f1-d022-4174-af7a-a41b85a3213e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7bb10d-ba6b-4e22-a484-409fe246aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7bb10d-ba6b-4e22-a484-409fe246aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5121e762-a4f8-4236-b5b8-61a56eab7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Volume f2e557f1-d022-4174-af7a-a41b85a3213e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e557f1-d022-4174-af7a-a41b85a3213e', 'volume_size': 1} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-445046740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e557f1-d022-4174-af7a-a41b85a3213e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8fc06af008415ea708c72013558ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:54Z,use_quota=True,user_id='aac136afa22346e8a970728bc18b47e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Creating volume f2e557f1-d022-4174-af7a-a41b85a3213e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:53 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:53 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e 1073741824 Sep 25 16:18:53 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:54 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e 1073741824" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:54 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e Sep 25 16:18:54 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:55 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e" returned: 0 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5121e762-a4f8-4236-b5b8-61a56eab7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e557f1-d022-4174-af7a-a41b85a3213e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9e5e13-2712-480b-9ce5-0411f3efdecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Volume volume-f2e557f1-d022-4174-af7a-a41b85a3213e (f2e557f1-d022-4174-af7a-a41b85a3213e): created successfully Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9e5e13-2712-480b-9ce5-0411f3efdecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Flow 'volume_create_manager' (487e9349-6255-42b6-b21e-5e3542fa0a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d9328952-a6a4-4634-b29a-2dc62dc4c0c7 tempest-VolumesTransfersTest-524882166 None] Created volume successfully. Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Acquiring lock "cinder-f2e557f1-d022-4174-af7a-a41b85a3213e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "cinder-f2e557f1-d022-4174-af7a-a41b85a3213e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Acquiring lock "cinder-quobyte-f2e557f1-d022-4174-af7a-a41b85a3213e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "cinder-quobyte-f2e557f1-d022-4174-af7a-a41b85a3213e" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6f74c8-171f-45ea-aa20-b83cd87e3616]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:56 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e Sep 25 16:18:56 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:57 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e" returned: 0 in 0.609s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:57 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e Sep 25 16:18:57 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:57 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f2e557f1-d022-4174-af7a-a41b85a3213e" returned: 0 in 0.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "cinder-quobyte-f2e557f1-d022-4174-af7a-a41b85a3213e" released by "delete_volume" :: held 1.102s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Created reservations ['2472b4ea-4e55-47b4-9e94-aedc0eb1573e', 'cb590824-3da8-464c-86b2-fe3a7f8dd8d9', '3ceef6a0-d207-4cc9-a3a0-d8c8d80cd4be', '015bf13d-cbae-4ed2-a9bb-08acb2f7cc99'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:57 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:18:57 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.469s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Deleted volume successfully. Sep 25 16:18:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-242be3d2-8f7f-41f9-9cc7-8bc967d2558e tempest-VolumesTransfersTest-850971566 None] Lock "cinder-f2e557f1-d022-4174-af7a-a41b85a3213e-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:06 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:19:06 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:06 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.572s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:19:07 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=61,cinder:SELECT=35,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:08 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=47,cinder:INSERT=13,cinder:UPDATE=56,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Flow 'volume_create_manager' (dc121374-b10a-42a9-919c-cbd1bb437b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043e265b-5930-4a65-82f2-329e9a28f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043e265b-5930-4a65-82f2-329e9a28f945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1518656885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e584c03-b5ab-48dc-909e-8be7ff69bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ec21c79c7e4078be5b300ab412bb82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:27Z,use_quota=True,user_id='df6ef8f0431c4b5c9151c621aa55c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b641379f-0702-476c-b619-4916195bb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b641379f-0702-476c-b619-4916195bb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1f93d2-5405-49ce-82e3-bf891dede035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1f93d2-5405-49ce-82e3-bf891dede035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e584c03-b5ab-48dc-909e-8be7ff69bb09', 'volume_name': 'volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80236238-97d5-4554-b14e-585f1b7f843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80236238-97d5-4554-b14e-585f1b7f843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d4bd4e-fb4d-4b59-ba16-0985ae9a1913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09', 'volume_size': 1} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1518656885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e584c03-b5ab-48dc-909e-8be7ff69bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ec21c79c7e4078be5b300ab412bb82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:27Z,use_quota=True,user_id='df6ef8f0431c4b5c9151c621aa55c798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Creating volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:27 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 1073741824 Sep 25 16:19:27 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:28 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 1073741824" returned: 0 in 0.861s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:28 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:19:28 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:28 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.430s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d4bd4e-fb4d-4b59-ba16-0985ae9a1913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559523a3-acd5-415f-96ad-0e3381996781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Volume volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 (4e584c03-b5ab-48dc-909e-8be7ff69bb09): created successfully Sep 25 16:19:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559523a3-acd5-415f-96ad-0e3381996781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Flow 'volume_create_manager' (dc121374-b10a-42a9-919c-cbd1bb437b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-84a2d971-09c7-40d4-8934-cc5872baff4f tempest-VolumesActionsTest-780027533 None] Created volume successfully. Sep 25 16:19:39 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:39 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (2ae60129-892c-4862-b022-471f0287c2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccec9f8-6e95-4239-b7ee-637ceb27bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccec9f8-6e95-4239-b7ee-637ceb27bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1641743175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c88168-de86-4d33-970a-607c266a5934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:41Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a211f9e3-5607-4f61-ae87-df6d3ec5dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a211f9e3-5607-4f61-ae87-df6d3ec5dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15464443-de29-451b-bc3c-79110ae7ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15464443-de29-451b-bc3c-79110ae7ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c88168-de86-4d33-970a-607c266a5934', 'volume_name': 'volume-70c88168-de86-4d33-970a-607c266a5934', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8191b4f-fa8a-47cf-9578-d613d382a2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8191b4f-fa8a-47cf-9578-d613d382a2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a448861-61a4-4f45-8ea0-60e74ca5e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Volume 70c88168-de86-4d33-970a-607c266a5934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c88168-de86-4d33-970a-607c266a5934', 'volume_size': 1} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1641743175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c88168-de86-4d33-970a-607c266a5934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:41Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Creating volume 70c88168-de86-4d33-970a-607c266a5934 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:19:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:41 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 1073741824 Sep 25 16:19:41 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:42 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 1073741824" returned: 0 in 0.994s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:42 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 Sep 25 16:19:42 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:42 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934" returned: 0 in 0.350s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a448861-61a4-4f45-8ea0-60e74ca5e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c88168-de86-4d33-970a-607c266a5934', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b446b-1b4d-421e-be7d-c3b9020399d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Volume volume-70c88168-de86-4d33-970a-607c266a5934 (70c88168-de86-4d33-970a-607c266a5934): created successfully Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b446b-1b4d-421e-be7d-c3b9020399d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (2ae60129-892c-4862-b022-471f0287c2f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-893a206f-e273-4d3a-adcc-c619a72f5751 tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:19:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-afc1fd62-fcf1-45b5-995b-b47a678bbc7c tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-70c88168-de86-4d33-970a-607c266a5934" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-afc1fd62-fcf1-45b5-995b-b47a678bbc7c tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934" acquired by "attach_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-afc1fd62-fcf1-45b5-995b-b47a678bbc7c tempest-VolumesActionsTest-1579516479 None] Attaching volume 70c88168-de86-4d33-970a-607c266a5934 to instance b1742d6f-0b20-402a-8838-65a6f4437c68 at mountpoint /dev/vdb on host None. Sep 25 16:19:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-afc1fd62-fcf1-45b5-995b-b47a678bbc7c tempest-VolumesActionsTest-1579516479 None] Attach volume completed successfully. Sep 25 16:19:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-afc1fd62-fcf1-45b5-995b-b47a678bbc7c tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934" released by "attach_volume" :: held 0.126s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Terminate volume connection completed successfully. Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Detaching volume 70c88168-de86-4d33-970a-607c266a5934 from instance b1742d6f-0b20-402a-8838-65a6f4437c68. Sep 25 16:19:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Detach volume completed successfully. Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ff2a98b-fe55-4ba2-80a4-77bc79f76aa9 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-14d18417-da93-44df-a6e0-d5058a821a23 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-14d18417-da93-44df-a6e0-d5058a821a23 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-14d18417-da93-44df-a6e0-d5058a821a23 tempest-VolumesActionsTest-1579516479 None] Volume detach called, but volume not attached. Sep 25 16:19:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-14d18417-da93-44df-a6e0-d5058a821a23 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-70c88168-de86-4d33-970a-607c266a5934-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-quobyte-70c88168-de86-4d33-970a-607c266a5934" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "cinder-quobyte-70c88168-de86-4d33-970a-607c266a5934" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b03dae4-4adc-4bfa-9539-8ed42cd91700]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:45 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 Sep 25 16:19:45 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:45 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934" returned: 0 in 0.542s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:45 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934 Sep 25 16:19:45 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd6fe62c-1182-4d97-a27d-1d309d07ed75 tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd6fe62c-1182-4d97-a27d-1d309d07ed75 tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" acquired by "attach_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:46 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-70c88168-de86-4d33-970a-607c266a5934" returned: 0 in 0.525s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "cinder-quobyte-70c88168-de86-4d33-970a-607c266a5934" released by "delete_volume" :: held 1.158s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd6fe62c-1182-4d97-a27d-1d309d07ed75 tempest-VolumesActionsTest-780027533 None] Attaching volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09 to instance 12d7ec00-dd30-4ca3-9797-7c9504d40c28 at mountpoint /dev/vdb on host None. Sep 25 16:19:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd6fe62c-1182-4d97-a27d-1d309d07ed75 tempest-VolumesActionsTest-780027533 None] Attach volume completed successfully. Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd6fe62c-1182-4d97-a27d-1d309d07ed75 tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" released by "attach_volume" :: held 0.257s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Created reservations ['45bb4b4a-2636-4fea-8189-c46eebb8fd11', '3e725549-00e0-4087-a724-3ff3aa0d224c', '0a437057-8442-46ae-9bb0-ca1f2e229c6d', '0b9a9247-215e-47e3-b6d1-538405959120'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:46 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:19:46 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-89cf00ec-50b5-4f38-8bc3-9aa27266a397 tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-89cf00ec-50b5-4f38-8bc3-9aa27266a397 tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-89cf00ec-50b5-4f38-8bc3-9aa27266a397 tempest-VolumesActionsTest-780027533 None] Detaching volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09 from instance 12d7ec00-dd30-4ca3-9797-7c9504d40c28. Sep 25 16:19:46 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.340s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Deleted volume successfully. Sep 25 16:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3305a22-1026-4382-9998-e74c4c5a7d9a tempest-VolumesActionsTest-1579516479 None] Lock "cinder-70c88168-de86-4d33-970a-607c266a5934-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-89cf00ec-50b5-4f38-8bc3-9aa27266a397 tempest-VolumesActionsTest-780027533 None] Detach volume completed successfully. Sep 25 16:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-89cf00ec-50b5-4f38-8bc3-9aa27266a397 tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Flow 'volume_create_manager' (c7c4817a-9f79-413b-8880-5e3a5b411eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d31cbc-468e-411c-8391-a6c7662b8dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d31cbc-468e-411c-8391-a6c7662b8dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1541683234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a139cd2-49a1-4765-b445-3f1cbe5edd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a09ab2aaa45e49b4ca565b1de4e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:51Z,use_quota=True,user_id='779d8d12f2b74cdea51d2a4a17e60c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef15e51-e414-46a4-a3a8-e63efc6f39ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef15e51-e414-46a4-a3a8-e63efc6f39ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8020d364-a0a2-43f6-bf8e-69352550d0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8020d364-a0a2-43f6-bf8e-69352550d0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a139cd2-49a1-4765-b445-3f1cbe5edd98', 'volume_name': 'volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465fa296-5171-4eb8-b7fa-21bc30e0717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465fa296-5171-4eb8-b7fa-21bc30e0717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc355d3-f031-4a14-8ce8-00e79a7230ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Volume 8a139cd2-49a1-4765-b445-3f1cbe5edd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98', 'volume_size': 1} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1541683234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a139cd2-49a1-4765-b445-3f1cbe5edd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a09ab2aaa45e49b4ca565b1de4e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:51Z,use_quota=True,user_id='779d8d12f2b74cdea51d2a4a17e60c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Creating volume 8a139cd2-49a1-4765-b445-3f1cbe5edd98 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:51 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 1073741824 Sep 25 16:19:51 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:51 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 1073741824" returned: 0 in 0.583s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:51 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 Sep 25 16:19:51 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:52 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98" returned: 0 in 0.402s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc355d3-f031-4a14-8ce8-00e79a7230ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d38f0ce-df55-414f-b3dc-d5bbde6ebca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Volume volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 (8a139cd2-49a1-4765-b445-3f1cbe5edd98): created successfully Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d38f0ce-df55-414f-b3dc-d5bbde6ebca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Flow 'volume_create_manager' (c7c4817a-9f79-413b-8880-5e3a5b411eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a13d4a28-9a0d-4950-a11b-db1dccee10dd tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Created volume successfully. Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (7dc675b7-bd5f-42f8-a809-f8d4af78cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f0ce7e-8a03-46da-85b5-2f1479068d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f0ce7e-8a03-46da-85b5-2f1479068d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306659030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496dccb7-1999-44f8-b28c-959e7f63afc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:53Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b11752-6911-4017-b9f1-6f52f0265a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b11752-6911-4017-b9f1-6f52f0265a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d899bb8e-09de-417a-9e3a-c23661502456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d899bb8e-09de-417a-9e3a-c23661502456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496dccb7-1999-44f8-b28c-959e7f63afc1', 'volume_name': 'volume-496dccb7-1999-44f8-b28c-959e7f63afc1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb5a716-7c26-463a-a7b4-e96b865aeeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb5a716-7c26-463a-a7b4-e96b865aeeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2434ca4-0cd0-47be-ab51-670c4b3269cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Volume 496dccb7-1999-44f8-b28c-959e7f63afc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496dccb7-1999-44f8-b28c-959e7f63afc1', 'volume_size': 1} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306659030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496dccb7-1999-44f8-b28c-959e7f63afc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:53Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Creating volume 496dccb7-1999-44f8-b28c-959e7f63afc1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:53 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:53 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 1073741824 Sep 25 16:19:53 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:53 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 1073741824" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:53 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 Sep 25 16:19:53 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:54 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1" returned: 0 in 0.454s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2434ca4-0cd0-47be-ab51-670c4b3269cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496dccb7-1999-44f8-b28c-959e7f63afc1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656930a-4670-4fb1-a217-1a7d8df1ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Volume volume-496dccb7-1999-44f8-b28c-959e7f63afc1 (496dccb7-1999-44f8-b28c-959e7f63afc1): created successfully Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656930a-4670-4fb1-a217-1a7d8df1ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (7dc675b7-bd5f-42f8-a809-f8d4af78cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-14874b62-471d-4276-a43d-ac3d4953a3eb tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-97f7b322-9ef6-4c47-b503-f17fc216a155 req-c71207f7-2d9f-45ea-978d-3b652ddadd1e tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-97f7b322-9ef6-4c47-b503-f17fc216a155 req-c71207f7-2d9f-45ea-978d-3b652ddadd1e tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-97f7b322-9ef6-4c47-b503-f17fc216a155 req-c71207f7-2d9f-45ea-978d-3b652ddadd1e tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-97f7b322-9ef6-4c47-b503-f17fc216a155 req-c71207f7-2d9f-45ea-978d-3b652ddadd1e tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e855971-43bb-4536-9d87-7aec258224e0', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-97f7b322-9ef6-4c47-b503-f17fc216a155 req-c71207f7-2d9f-45ea-978d-3b652ddadd1e tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] attachment_update completed successfully. Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-496dccb7-1999-44f8-b28c-959e7f63afc1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "cinder-496dccb7-1999-44f8-b28c-959e7f63afc1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-quobyte-496dccb7-1999-44f8-b28c-959e7f63afc1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-496dccb7-1999-44f8-b28c-959e7f63afc1" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fe120-f9f8-41ff-9e44-c2439951b0c6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:55 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 Sep 25 16:19:55 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:55 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1" returned: 0 in 0.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:55 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1 Sep 25 16:19:55 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:56 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-496dccb7-1999-44f8-b28c-959e7f63afc1" returned: 0 in 0.275s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-496dccb7-1999-44f8-b28c-959e7f63afc1" released by "delete_volume" :: held 0.834s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Created reservations ['b584540e-1c57-49aa-ab0c-d225c1dfd941', '21a7ff64-0581-42e3-aa4f-18f3e4215492', 'e6cc4613-ebcb-400e-8a06-e4b0e0ab4f85', '19726d0f-ab4e-4a93-b48a-a77140d09ee5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:56 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:19:56 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:56 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.364s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Deleted volume successfully. Sep 25 16:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74b2220-af7e-4c1b-8359-bfe7693a04bd tempest-VolumesActionsTest-1712605894 None] Lock "cinder-496dccb7-1999-44f8-b28c-959e7f63afc1-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (400e454f-af82-4138-9b71-9221b9cfa111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c4a9d4-f67e-4fa2-933c-b2fdfa2069ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c4a9d4-f67e-4fa2-933c-b2fdfa2069ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915112734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df84df9a-3132-4562-bc12-0a4beb0a5c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:57Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60c5010-e513-4fe4-a693-12a3597dbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60c5010-e513-4fe4-a693-12a3597dbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d5f5d2-1312-46c2-a865-b56fdb84c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d5f5d2-1312-46c2-a865-b56fdb84c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df84df9a-3132-4562-bc12-0a4beb0a5c62', 'volume_name': 'volume-df84df9a-3132-4562-bc12-0a4beb0a5c62', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd670da-4e49-446b-8f95-f7e568625b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd670da-4e49-446b-8f95-f7e568625b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c4d5a9-0fd5-4a79-8b8f-d3ba3ed9717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Volume df84df9a-3132-4562-bc12-0a4beb0a5c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df84df9a-3132-4562-bc12-0a4beb0a5c62', 'volume_size': 1} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915112734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df84df9a-3132-4562-bc12-0a4beb0a5c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:57Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Creating volume df84df9a-3132-4562-bc12-0a4beb0a5c62 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:57 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 1073741824 Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:57 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 1073741824" returned: 0 in 0.942s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 Sep 25 16:19:58 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c4d5a9-0fd5-4a79-8b8f-d3ba3ed9717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df84df9a-3132-4562-bc12-0a4beb0a5c62', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3599c8-52b5-48ab-9463-d06841f49848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Volume volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 (df84df9a-3132-4562-bc12-0a4beb0a5c62): created successfully Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3599c8-52b5-48ab-9463-d06841f49848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (400e454f-af82-4138-9b71-9221b9cfa111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8805f8a5-f8b4-44b7-891d-0bd5f4b4bd14 tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:19:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-8e52978a-24f2-4b28-878b-092d5e87f318 req-dc7e9bd0-8ff9-4952-a8b8-c7cbf78451e8 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Terminate volume connection completed successfully. Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-8e52978a-24f2-4b28-878b-092d5e87f318 req-dc7e9bd0-8ff9-4952-a8b8-c7cbf78451e8 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Deleting attachment 9e855971-43bb-4536-9d87-7aec258224e0. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-df84df9a-3132-4562-bc12-0a4beb0a5c62-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-df84df9a-3132-4562-bc12-0a4beb0a5c62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-quobyte-df84df9a-3132-4562-bc12-0a4beb0a5c62" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "cinder-8a139cd2-49a1-4765-b445-3f1cbe5edd98-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-df84df9a-3132-4562-bc12-0a4beb0a5c62" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "cinder-8a139cd2-49a1-4765-b445-3f1cbe5edd98-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdd629-888b-467a-8322-1b57df7c5ede]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "cinder-quobyte-8a139cd2-49a1-4765-b445-3f1cbe5edd98" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "cinder-quobyte-8a139cd2-49a1-4765-b445-3f1cbe5edd98" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ac583-99de-4fac-8ad7-b62e73ee0434]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:00 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 Sep 25 16:20:00 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:00 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 Sep 25 16:20:00 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:00 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62" returned: 0 in 0.611s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:00 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62 Sep 25 16:20:00 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:00 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98" returned: 0 in 0.560s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:00 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98 Sep 25 16:20:00 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:00 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-df84df9a-3132-4562-bc12-0a4beb0a5c62" returned: 0 in 0.363s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-df84df9a-3132-4562-bc12-0a4beb0a5c62" released by "delete_volume" :: held 1.137s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:01 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8a139cd2-49a1-4765-b445-3f1cbe5edd98" returned: 0 in 0.352s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Created reservations ['497b064d-a26d-4d59-af94-23d75f8fb548', '98a54298-9147-4e0c-9edd-23de340707df', 'ac3dfe86-53fa-4d1b-b228-46f9023b550f', '468309a6-3e25-44fd-8462-5362841b55c7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "cinder-quobyte-8a139cd2-49a1-4765-b445-3f1cbe5edd98" released by "delete_volume" :: held 0.994s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Created reservations ['fa6df7f9-b634-436a-bd47-1c45b3a608dc', 'ef418e14-6b9e-4faa-9889-582ef9ca9dd2', '7b459aa6-0c2d-41f7-bfbc-d4d6e3b11010', 'ec8c64b9-9d95-44c9-b208-46a695e39d54'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:01 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:01 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:01 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:01 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:01 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Deleted volume successfully. Sep 25 16:20:01 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.289s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Deleted volume successfully. Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5bb68692-0ad4-419d-b404-854233fcc9e6 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-df84df9a-3132-4562-bc12-0a4beb0a5c62-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-52b78c04-af90-450d-8792-e46ae7a41ff5 tempest-TestServerVolumeAttachScenarioOldVersion-560971287 None] Lock "cinder-8a139cd2-49a1-4765-b445-3f1cbe5edd98-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-473ae7de-ec40-4275-8678-ff596817a8af tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-473ae7de-ec40-4275-8678-ff596817a8af tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" acquired by "attach_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-473ae7de-ec40-4275-8678-ff596817a8af tempest-VolumesActionsTest-780027533 None] Attaching volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09 to instance 06cdbd80-1cd0-44d3-8964-3ee5243c0cad at mountpoint /dev/vdb on host None. Sep 25 16:20:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-473ae7de-ec40-4275-8678-ff596817a8af tempest-VolumesActionsTest-780027533 None] Attach volume completed successfully. Sep 25 16:20:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-473ae7de-ec40-4275-8678-ff596817a8af tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09" released by "attach_volume" :: held 0.125s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3112c15-8e9c-46c9-b79b-ebfa8805a29e tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3112c15-8e9c-46c9-b79b-ebfa8805a29e tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d3112c15-8e9c-46c9-b79b-ebfa8805a29e tempest-VolumesActionsTest-780027533 None] Detaching volume 4e584c03-b5ab-48dc-909e-8be7ff69bb09 from instance 06cdbd80-1cd0-44d3-8964-3ee5243c0cad. Sep 25 16:20:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d3112c15-8e9c-46c9-b79b-ebfa8805a29e tempest-VolumesActionsTest-780027533 None] Detach volume completed successfully. Sep 25 16:20:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3112c15-8e9c-46c9-b79b-ebfa8805a29e tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-detach_volume" released by "detach_volume" :: held 0.226s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (bc007f02-6ca7-4d20-bbb1-7d49735734fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90dd01a-a20d-487b-b8c3-8b7cb6465c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90dd01a-a20d-487b-b8c3-8b7cb6465c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1277055372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82eb2657-f449-4d59-94ad-bf5811df6977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:03Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e1c44-d08b-44af-9925-40ae575fdfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e1c44-d08b-44af-9925-40ae575fdfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb3578-5304-4793-a19b-e6011bc78e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb3578-5304-4793-a19b-e6011bc78e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82eb2657-f449-4d59-94ad-bf5811df6977', 'volume_name': 'volume-82eb2657-f449-4d59-94ad-bf5811df6977', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59256f21-746f-4315-a065-1eeb6a6cb64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59256f21-746f-4315-a065-1eeb6a6cb64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e4738a-444a-4f68-bca1-23981154feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Volume 82eb2657-f449-4d59-94ad-bf5811df6977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82eb2657-f449-4d59-94ad-bf5811df6977', 'volume_size': 1} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1277055372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82eb2657-f449-4d59-94ad-bf5811df6977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:03Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Creating volume 82eb2657-f449-4d59-94ad-bf5811df6977 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:03 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 1073741824 Sep 25 16:20:03 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:04 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 1073741824" returned: 0 in 1.019s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:04 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 Sep 25 16:20:04 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:04 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e4738a-444a-4f68-bca1-23981154feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82eb2657-f449-4d59-94ad-bf5811df6977', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd364bdc-57a6-43b0-a3c5-b6fbc11ca004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Volume volume-82eb2657-f449-4d59-94ad-bf5811df6977 (82eb2657-f449-4d59-94ad-bf5811df6977): created successfully Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd364bdc-57a6-43b0-a3c5-b6fbc11ca004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (bc007f02-6ca7-4d20-bbb1-7d49735734fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30bc9e8f-9184-4db6-9081-e783b2c23aa6 tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-82eb2657-f449-4d59-94ad-bf5811df6977-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-82eb2657-f449-4d59-94ad-bf5811df6977-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-quobyte-82eb2657-f449-4d59-94ad-bf5811df6977" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-82eb2657-f449-4d59-94ad-bf5811df6977" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584cd9d-1532-471b-af69-85cbd4172c31]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:05 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 Sep 25 16:20:05 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:06 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:06 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:06 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977" returned: 0 in 0.622s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:06 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977 Sep 25 16:20:06 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:06 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.426s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:20:06 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-82eb2657-f449-4d59-94ad-bf5811df6977" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-82eb2657-f449-4d59-94ad-bf5811df6977" released by "delete_volume" :: held 1.031s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Created reservations ['c26cb567-0d58-429d-aa4d-5149883fb871', 'd3c41c46-186d-49af-a03a-3da9baa9fc82', 'cb053343-4fd3-4d08-bf16-e7ca8e883417', '4385c364-aad0-451b-b9f2-35da40aabd0e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:07 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:07 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:07 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Deleted volume successfully. Sep 25 16:20:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1173e14a-bf0e-478c-aac6-a9db483f6c53 tempest-VolumesActionsTest-1712605894 None] Lock "cinder-82eb2657-f449-4d59-94ad-bf5811df6977-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (eaf4476e-8286-4f49-acb4-c4ac40bc5b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9892587-e863-42ba-ba79-f0f0f08bea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9892587-e863-42ba-ba79-f0f0f08bea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e1c498-5915-44cf-b37b-b47f146e5022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:09Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d549cac8-ccaa-4f12-a9a9-c9eae88c4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d549cac8-ccaa-4f12-a9a9-c9eae88c4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7f5838-4d79-4f2c-9005-da824691b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7f5838-4d79-4f2c-9005-da824691b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e1c498-5915-44cf-b37b-b47f146e5022', 'volume_name': 'volume-21e1c498-5915-44cf-b37b-b47f146e5022', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b5f44d-1062-494f-9bde-7d023e8eed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b5f44d-1062-494f-9bde-7d023e8eed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe2aac2-efd7-4812-bc44-60e046002176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Volume 21e1c498-5915-44cf-b37b-b47f146e5022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e1c498-5915-44cf-b37b-b47f146e5022', 'volume_size': 1} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e1c498-5915-44cf-b37b-b47f146e5022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:09Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Creating volume 21e1c498-5915-44cf-b37b-b47f146e5022 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:08 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:08 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 1073741824 Sep 25 16:20:08 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:09 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 1073741824" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:09 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 Sep 25 16:20:09 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:09 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022" returned: 0 in 0.336s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.184s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe2aac2-efd7-4812-bc44-60e046002176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e1c498-5915-44cf-b37b-b47f146e5022', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac1f0d-6e8b-42c0-8be8-1a09242fd666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94f1082-d4a0-40aa-a505-5da890ec32b4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Volume volume-21e1c498-5915-44cf-b37b-b47f146e5022 (21e1c498-5915-44cf-b37b-b47f146e5022): created successfully Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac1f0d-6e8b-42c0-8be8-1a09242fd666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (eaf4476e-8286-4f49-acb4-c4ac40bc5b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c06aebef-5142-4959-8b67-494f39e63170 tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:20:09 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:09 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:10 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.435s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a262620-7221-4474-82dd-6ff580cd7892]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:10 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:10 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:10 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.837f537e-3046-47f2-98e6-eae39ae78d0biwc0yb3s.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:10 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.837f537e-3046-47f2-98e6-eae39ae78d0biwc0yb3s.img Sep 25 16:20:10 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-21e1c498-5915-44cf-b37b-b47f146e5022-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "cinder-21e1c498-5915-44cf-b37b-b47f146e5022-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Acquiring lock "cinder-quobyte-21e1c498-5915-44cf-b37b-b47f146e5022" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-21e1c498-5915-44cf-b37b-b47f146e5022" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f1517-7c33-4c2a-a230-c3b019668521]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:11 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 Sep 25 16:20:11 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:11 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022" returned: 0 in 0.641s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:11 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022 Sep 25 16:20:11 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:12 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21e1c498-5915-44cf-b37b-b47f146e5022" returned: 0 in 0.610s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "cinder-quobyte-21e1c498-5915-44cf-b37b-b47f146e5022" released by "delete_volume" :: held 1.313s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Created reservations ['339443e5-aaa2-46f1-ad2a-03aa380e57e7', 'b5be99c7-b64d-4389-9ae5-302da4378934', 'bfbdb5f7-3874-40fc-bcd2-d645bbcebc5b', '158e6234-4dae-4bf9-ab88-580886f19602'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:12 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:12 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:13 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Deleted volume successfully. Sep 25 16:20:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f43304f0-bef7-4466-9c3e-8f18dc1c3bae tempest-VolumesActionsTest-1712605894 None] Lock "cinder-21e1c498-5915-44cf-b37b-b47f146e5022-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (682b00c6-f635-4a7d-b253-feb2a3229088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b38fc6-6eb5-40b3-96dc-965eae9d89c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b38fc6-6eb5-40b3-96dc-965eae9d89c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306061669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8566a2af-7065-431a-95ee-8b1aa989869b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:14Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eb0fae-3c3c-4b37-9416-487d647c04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eb0fae-3c3c-4b37-9416-487d647c04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f2d9c8-ad7f-45c6-8d26-25773fb1faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f2d9c8-ad7f-45c6-8d26-25773fb1faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8566a2af-7065-431a-95ee-8b1aa989869b', 'volume_name': 'volume-8566a2af-7065-431a-95ee-8b1aa989869b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5894c11d-9525-4728-a517-c9d7fe2e7740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5894c11d-9525-4728-a517-c9d7fe2e7740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe562e4a-e166-435d-9228-e903a24b5275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Volume 8566a2af-7065-431a-95ee-8b1aa989869b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8566a2af-7065-431a-95ee-8b1aa989869b', 'volume_size': 1} Sep 25 16:20:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:18 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.837f537e-3046-47f2-98e6-eae39ae78d0biwc0yb3s.img" returned: 0 in 7.535s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7f11c-e304-4be6-9e5e-59d80788900b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:18 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:18 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:18 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.837f537e-3046-47f2-98e6-eae39ae78d0biwc0yb3s.img {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:18 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Converted 1024.00 MB image at 135.88 MB/s Sep 25 16:20:18 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] 837f537e-3046-47f2-98e6-eae39ae78d0b was raw, no need to convert to raw {{(pid=87199) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 16:20:24 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=74,cinder:INSERT=13,cinder:UPDATE=73,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (0cb03a15-397f-430e-8abc-9aa538b185b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a58004-1be0-4d9f-a76d-99c1f6f6a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a58004-1be0-4d9f-a76d-99c1f6f6a271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839923098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b579094-2100-440d-bc4b-324491b1679d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:27Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f20c03d-f3ac-44c7-ab61-7329277b8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f20c03d-f3ac-44c7-ab61-7329277b8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ba52c4-d572-49be-90b6-3e2d0160f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ba52c4-d572-49be-90b6-3e2d0160f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b579094-2100-440d-bc4b-324491b1679d', 'volume_name': 'volume-0b579094-2100-440d-bc4b-324491b1679d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d34dc2-6932-4461-9901-17cd9347184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d34dc2-6932-4461-9901-17cd9347184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e61a20-cd2f-487e-a24f-a968df3a67dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Volume 0b579094-2100-440d-bc4b-324491b1679d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b579094-2100-440d-bc4b-324491b1679d', 'volume_size': 1} Sep 25 16:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:37 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=83,cinder:SELECT=71,cinder:DELETE=9,cinder:INSERT=23 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:37 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.706s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Uploaded volume to glance image-id: 837f537e-3046-47f2-98e6-eae39ae78d0b. {{(pid=87199) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.759s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306061669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8566a2af-7065-431a-95ee-8b1aa989869b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930204ecc644e9499a5345d5e9f9cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:14Z,use_quota=True,user_id='634d02b4ae3a4e44851b9ffd8efea69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Creating volume 8566a2af-7065-431a-95ee-8b1aa989869b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:39 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b 1073741824 Sep 25 16:20:39 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6dae9860-f80f-4816-a5e4-2ed8eededf09 tempest-VolumesActionsTest-780027533 None] Copy volume to image completed successfully. Sep 25 16:20:39 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b 1073741824" returned: 0 in 0.490s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b Sep 25 16:20:40 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:40 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b" returned: 0 in 0.259s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.965s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839923098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b579094-2100-440d-bc4b-324491b1679d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:27Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Creating volume 0b579094-2100-440d-bc4b-324491b1679d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe562e4a-e166-435d-9228-e903a24b5275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8566a2af-7065-431a-95ee-8b1aa989869b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:40 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d 1073741824 Sep 25 16:20:40 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d37695-392d-422c-af68-d338dc0d409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Volume volume-8566a2af-7065-431a-95ee-8b1aa989869b (8566a2af-7065-431a-95ee-8b1aa989869b): created successfully Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d37695-392d-422c-af68-d338dc0d409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Flow 'volume_create_manager' (682b00c6-f635-4a7d-b253-feb2a3229088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d55337ed-1303-4e18-b2bf-48ca673196ef tempest-VolumesActionsTest-1579516479 None] Created volume successfully. Sep 25 16:20:40 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d 1073741824" returned: 0 in 0.617s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d Sep 25 16:20:40 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:41 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.245s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e61a20-cd2f-487e-a24f-a968df3a67dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b579094-2100-440d-bc4b-324491b1679d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0268dee4-0984-4465-9ad9-0f8c36eb9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd77a2e-9793-41e8-9af1-4bcd738a2cfe]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Volume volume-0b579094-2100-440d-bc4b-324491b1679d (0b579094-2100-440d-bc4b-324491b1679d): created successfully Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0268dee4-0984-4465-9ad9-0f8c36eb9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (0cb03a15-397f-430e-8abc-9aa538b185b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1be99792-b011-406a-8029-777992bdcbd2 tempest-ProjectReaderTests-1792160337 None] Created volume successfully. Sep 25 16:20:41 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:41 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-8566a2af-7065-431a-95ee-8b1aa989869b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-8566a2af-7065-431a-95ee-8b1aa989869b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "cinder-quobyte-8566a2af-7065-431a-95ee-8b1aa989869b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-quobyte-8566a2af-7065-431a-95ee-8b1aa989869b" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b10d3c-f224-462c-94cb-6ac12a1bb5aa]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:41 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b Sep 25 16:20:41 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:41 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.450s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff2a8fe-27e6-4f05-9dd4-b603f9391dbe]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:41 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:41 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:42 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b" returned: 0 in 0.499s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:42 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b Sep 25 16:20:42 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:42 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.449s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:42 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img Sep 25 16:20:42 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:42 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8566a2af-7065-431a-95ee-8b1aa989869b" returned: 0 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-quobyte-8566a2af-7065-431a-95ee-8b1aa989869b" released by "delete_volume" :: held 0.912s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Created reservations ['26d5b134-3610-4099-820d-216377003c1a', '2770327d-e1e2-403d-b7c4-66b39900c6e3', '6a6400f7-6675-4348-a2be-a96d3fa6d6a4', 'ace9d796-697c-478f-89a0-f078851f0642'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-0b579094-2100-440d-bc4b-324491b1679d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "cinder-0b579094-2100-440d-bc4b-324491b1679d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-quobyte-0b579094-2100-440d-bc4b-324491b1679d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-0b579094-2100-440d-bc4b-324491b1679d" acquired by "delete_volume" :: waited 0.077s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:42 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:42 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d33296-c0d6-4ec0-a7b8-1ce7b505094b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:43 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d Sep 25 16:20:43 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:43 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Deleted volume successfully. Sep 25 16:20:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6f1212a3-b49a-4d6b-b874-a3a53d2335b6 tempest-VolumesActionsTest-1579516479 None] Lock "cinder-8566a2af-7065-431a-95ee-8b1aa989869b-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:44 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d" returned: 0 in 1.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:44 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d Sep 25 16:20:44 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:44 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b579094-2100-440d-bc4b-324491b1679d" returned: 0 in 0.412s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-0b579094-2100-440d-bc4b-324491b1679d" released by "delete_volume" :: held 1.845s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Created reservations ['958317b7-4c2d-4135-ada3-7aa267098221', 'e8c915f8-63a7-4e0d-af92-afd5ed8ab80b', '3b94d07e-b674-492b-98ab-f9dd8a8b0517', '3b3768ca-ed61-49ff-bbce-92e552ecfdd0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:44 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:44 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:45 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.802s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Deleted volume successfully. Sep 25 16:20:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d417faa0-b988-4225-8d92-fc1e53299eab tempest-ProjectReaderTests-1792160337 None] Lock "cinder-0b579094-2100-440d-bc4b-324491b1679d-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (e2e092e2-e20b-4e0d-bd99-eaf6202731cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2f3b1f-6887-4749-beac-b2ba97d23948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2f3b1f-6887-4749-beac-b2ba97d23948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1649846771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e851792-e6c7-4f81-b05b-336fa6cec4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:47Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f675a-9b0a-4804-8ade-2c9e769acc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f675a-9b0a-4804-8ade-2c9e769acc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bdd33a-55a9-4652-87ff-414cfc3706bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bdd33a-55a9-4652-87ff-414cfc3706bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e851792-e6c7-4f81-b05b-336fa6cec4ff', 'volume_name': 'volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ffa01c-b2cf-492e-926f-4dfd18ca20f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ffa01c-b2cf-492e-926f-4dfd18ca20f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e284789-087e-43ec-911f-5f086eb4b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Volume 6e851792-e6c7-4f81-b05b-336fa6cec4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff', 'volume_size': 1} Sep 25 16:20:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:50 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img" returned: 0 in 8.554s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a1ef7-75f2-4be1-bce5-a474f8117a70]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:50 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:50 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:51 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.610s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:51 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Converted 1024.00 MB image at 119.70 MB/s Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] 20908759-f0c8-4da1-bdb4-09f776a025d1 was raw, converting to qcow2 {{(pid=87199) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9297475-2678-4558-aed8-73063f1f77e8]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:51 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img Sep 25 16:20:51 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:51 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img" returned: 0 in 0.347s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:51 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img Sep 25 16:20:51 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img" returned: 1 in 0.394s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57 Sep 25 16:20:52 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57" returned: 0 in 0.279s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Image conversion details: src /opt/stack/data/cinder/conversion/4e584c03-b5ab-48dc-909e-8be7ff69bb09.temp_image.20908759-f0c8-4da1-bdb4-09f776a025d12gaebrlf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:52 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cbc182-3baf-4617-8bba-6f1ca396836f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57 Sep 25 16:20:52 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1qq3vy57" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.752s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Uploaded volume to glance image-id: 20908759-f0c8-4da1-bdb4-09f776a025d1. {{(pid=87199) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.192s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1649846771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e851792-e6c7-4f81-b05b-336fa6cec4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:47Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Creating volume 6e851792-e6c7-4f81-b05b-336fa6cec4ff {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff 1073741824 Sep 25 16:20:55 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5261b810-cf64-49cd-943a-23ac89322593 tempest-VolumesActionsTest-780027533 None] Copy volume to image completed successfully. Sep 25 16:20:55 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff 1073741824" returned: 0 in 0.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff Sep 25 16:20:55 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff" returned: 0 in 0.290s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e284789-087e-43ec-911f-5f086eb4b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85c7e7-5bec-48c5-a141-3588b375afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Volume volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff (6e851792-e6c7-4f81-b05b-336fa6cec4ff): created successfully Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85c7e7-5bec-48c5-a141-3588b375afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (e2e092e2-e20b-4e0d-bd99-eaf6202731cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-437363e9-f2c3-42e8-a85f-9469a7efb8ef tempest-ProjectReaderTests-1792160337 None] Created volume successfully. Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-6e851792-e6c7-4f81-b05b-336fa6cec4ff-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "cinder-6e851792-e6c7-4f81-b05b-336fa6cec4ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-quobyte-6e851792-e6c7-4f81-b05b-336fa6cec4ff" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-6e851792-e6c7-4f81-b05b-336fa6cec4ff" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[223fcedc-1cb1-4677-ad71-3b9bc49d9fdb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Acquiring lock "cinder-quobyte-4e584c03-b5ab-48dc-909e-8be7ff69bb09" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "cinder-quobyte-4e584c03-b5ab-48dc-909e-8be7ff69bb09" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91682e7-2d4a-4d4d-b706-deedd830afac]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:56 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff Sep 25 16:20:56 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:57 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff" returned: 0 in 0.504s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:57 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff Sep 25 16:20:57 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.525s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:57 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09 Sep 25 16:20:57 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e851792-e6c7-4f81-b05b-336fa6cec4ff" returned: 0 in 0.321s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-6e851792-e6c7-4f81-b05b-336fa6cec4ff" released by "delete_volume" :: held 0.878s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Created reservations ['b490c658-9d9c-4097-ac07-c293d5fa7db9', 'b88509f5-2087-4b2f-b1dc-086f32c9d8c2', '313e7000-b1fd-46f2-8288-ab78215d96de', '3231b4e5-20d2-43d2-b5ec-a3497a9d5a5b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:57 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4e584c03-b5ab-48dc-909e-8be7ff69bb09" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "cinder-quobyte-4e584c03-b5ab-48dc-909e-8be7ff69bb09" released by "delete_volume" :: held 0.963s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:57 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:57 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Created reservations ['6359fb99-8dba-46e7-9675-56cdbb9261de', 'b5b6214b-ec48-4c52-9668-c1261715e743', 'dc3921ba-7874-47bb-9477-1356487c3847', '24b6bccb-098a-4939-b3a6-f0e36d0a049e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:20:58 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:58 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Deleted volume successfully. Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-13b73740-c6ba-440a-805e-13997072d4ea tempest-ProjectReaderTests-1792160337 None] Lock "cinder-6e851792-e6c7-4f81-b05b-336fa6cec4ff-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:58 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Deleted volume successfully. Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91684ffd-3abe-4c31-885c-ba2e4b6ab6cd tempest-VolumesActionsTest-780027533 None] Lock "cinder-4e584c03-b5ab-48dc-909e-8be7ff69bb09-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (66966fa4-5a24-4b2b-b5a4-cf254021eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d355b9-44d8-43c0-803d-dbb9b518ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d355b9-44d8-43c0-803d-dbb9b518ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378877317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:58Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d0445-c55e-4c0c-9138-7725e5f071e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d0445-c55e-4c0c-9138-7725e5f071e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a072348-ec26-4da4-bdfd-9d40c329443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a072348-ec26-4da4-bdfd-9d40c329443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6', 'volume_name': 'volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc78c9e-4ea3-4c1e-9295-45737de11fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc78c9e-4ea3-4c1e-9295-45737de11fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c66872-b62a-442e-931b-297ebafb289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Volume aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6', 'volume_size': 1} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378877317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:58Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Creating volume aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 1073741824 Sep 25 16:20:58 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 1073741824" returned: 0 in 0.632s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:59 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 Sep 25 16:20:59 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c66872-b62a-442e-931b-297ebafb289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8740541-34b5-4f15-96bf-91d52cdbe619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Volume volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 (aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6): created successfully Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8740541-34b5-4f15-96bf-91d52cdbe619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (66966fa4-5a24-4b2b-b5a4-cf254021eab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8a3e58b4-ec56-4065-931f-c12d38b92321 tempest-ProjectReaderTests-1792160337 None] Created volume successfully. Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "cinder-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-quobyte-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7d2bb-7ba7-4734-8aab-83c6d392e0c1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:01 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 Sep 25 16:21:01 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:01 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" returned: 0 in 0.481s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:01 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6 Sep 25 16:21:01 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:01 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" returned: 0 in 0.313s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6" released by "delete_volume" :: held 0.869s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Created reservations ['3f5316d5-3926-4b6e-ab33-7fac232aef64', 'ad5856ce-98d6-4634-b441-f4b5e802efe9', '79e9eec1-4708-406e-b1d3-7f74c32749bd', '6dd84ef1-c890-4a36-bfcb-cafeb2fa2fcc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:01 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:01 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:02 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Deleted volume successfully. Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5f08ab20-650f-4994-8486-93e51dc10d79 tempest-ProjectReaderTests-1792160337 None] Lock "cinder-aa5b2c4e-76bf-4ba1-bae0-16a435aa54c6-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (23bb849e-f05f-4418-9108-41531c8044df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d66b89-9619-4a06-97c3-702f6f7f0caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d66b89-9619-4a06-97c3-702f6f7f0caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122372066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea99bb4c-8c11-4dd2-903f-4288ff527102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc46c652-f77a-45f6-917e-3308072a8320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc46c652-f77a-45f6-917e-3308072a8320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfeab25-83c6-4a70-9140-9229233161d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfeab25-83c6-4a70-9140-9229233161d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea99bb4c-8c11-4dd2-903f-4288ff527102', 'volume_name': 'volume-ea99bb4c-8c11-4dd2-903f-4288ff527102', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9430f36-8bbe-4afe-a8e7-da2ecc5faeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9430f36-8bbe-4afe-a8e7-da2ecc5faeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a959fffc-8067-4e14-a36f-7e694b6941e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Volume ea99bb4c-8c11-4dd2-903f-4288ff527102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea99bb4c-8c11-4dd2-903f-4288ff527102', 'volume_size': 1} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122372066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea99bb4c-8c11-4dd2-903f-4288ff527102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a51193fc2443099377ab7089d02700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='665b08549aee4e50912c6a6488d6f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Creating volume ea99bb4c-8c11-4dd2-903f-4288ff527102 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:02 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:02 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 1073741824 Sep 25 16:21:02 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (7abc169d-d4ab-4542-b26d-e7e44b202b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21551761-7e99-432a-b361-2b110e2c2857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21551761-7e99-432a-b361-2b110e2c2857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-839386435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6168f48f-9801-4f67-bd67-7526174f21e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7841ed1-63e9-4382-8c50-7eb17e6060e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7841ed1-63e9-4382-8c50-7eb17e6060e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186f798b-2ff8-4cdc-8717-d5058ad77ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186f798b-2ff8-4cdc-8717-d5058ad77ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6168f48f-9801-4f67-bd67-7526174f21e8', 'volume_name': 'volume-6168f48f-9801-4f67-bd67-7526174f21e8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dcd2b9-2161-48c9-8ed6-e8ec2c65edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dcd2b9-2161-48c9-8ed6-e8ec2c65edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a321c39-e8c1-4bd5-b610-b725d0a85c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Volume 6168f48f-9801-4f67-bd67-7526174f21e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6168f48f-9801-4f67-bd67-7526174f21e8', 'volume_size': 1} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:03 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 1073741824" returned: 0 in 0.571s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:03 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 Sep 25 16:21:03 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:03 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102" returned: 0 in 0.339s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-839386435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6168f48f-9801-4f67-bd67-7526174f21e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Creating volume 6168f48f-9801-4f67-bd67-7526174f21e8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a959fffc-8067-4e14-a36f-7e694b6941e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea99bb4c-8c11-4dd2-903f-4288ff527102', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e9e1aa-802f-47e2-a755-2aa91428acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 1073741824 Sep 25 16:21:03 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Volume volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 (ea99bb4c-8c11-4dd2-903f-4288ff527102): created successfully Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e9e1aa-802f-47e2-a755-2aa91428acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Flow 'volume_create_manager' (23bb849e-f05f-4418-9108-41531c8044df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ae10c0c2-16ef-40eb-add9-1a95d6cf6ee6 tempest-ProjectReaderTests-1792160337 None] Created volume successfully. Sep 25 16:21:04 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 1073741824" returned: 0 in 0.607s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:04 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 Sep 25 16:21:04 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:04 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a321c39-e8c1-4bd5-b610-b725d0a85c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6168f48f-9801-4f67-bd67-7526174f21e8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3337c96-350b-428f-849e-f3fa51a786ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Volume volume-6168f48f-9801-4f67-bd67-7526174f21e8 (6168f48f-9801-4f67-bd67-7526174f21e8): created successfully Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3337c96-350b-428f-849e-f3fa51a786ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (7abc169d-d4ab-4542-b26d-e7e44b202b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-37b02513-d176-43b8-8644-e4df207acae1 tempest-VolumesListAdminTestJSON-1261104723 None] Created volume successfully. Sep 25 16:21:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-ea99bb4c-8c11-4dd2-903f-4288ff527102-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "cinder-ea99bb4c-8c11-4dd2-903f-4288ff527102-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Acquiring lock "cinder-quobyte-ea99bb4c-8c11-4dd2-903f-4288ff527102" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-ea99bb4c-8c11-4dd2-903f-4288ff527102" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac03d3b-89f8-4fe5-b4d8-a17a33dbcbcd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:05 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 Sep 25 16:21:05 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:05 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102" returned: 0 in 0.565s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:05 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102 Sep 25 16:21:05 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (a84adad5-ca34-4f74-a49a-90413287a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858553bf-08b7-4ee4-a7c0-9421b3d50a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858553bf-08b7-4ee4-a7c0-9421b3d50a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1581843974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f686633e-e79a-496a-9cb8-9602541d05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:06Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e9d4c8-27fa-40f5-99f2-a16de6bbdee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e9d4c8-27fa-40f5-99f2-a16de6bbdee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d04220-efaa-4735-b03d-4449bbbc4564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d04220-efaa-4735-b03d-4449bbbc4564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f686633e-e79a-496a-9cb8-9602541d05a6', 'volume_name': 'volume-f686633e-e79a-496a-9cb8-9602541d05a6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a299636-53e3-475b-ba75-3ff74c779666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a299636-53e3-475b-ba75-3ff74c779666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af78d1-5cff-40a2-ab83-8b955b9d289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Volume f686633e-e79a-496a-9cb8-9602541d05a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f686633e-e79a-496a-9cb8-9602541d05a6', 'volume_size': 1} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1581843974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f686633e-e79a-496a-9cb8-9602541d05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:06Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Creating volume f686633e-e79a-496a-9cb8-9602541d05a6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:06 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 1073741824 Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ea99bb4c-8c11-4dd2-903f-4288ff527102" returned: 0 in 0.423s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:06 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "cinder-quobyte-ea99bb4c-8c11-4dd2-903f-4288ff527102" released by "delete_volume" :: held 1.074s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Created reservations ['3e137cd9-d51e-4519-8590-b70fa9603cd6', 'adc24f70-e5d6-4a30-bba2-4d3f5e378c02', '573b673a-d406-4845-9059-c7916546cd94', 'b10bdb90-bb2b-4658-a3c2-48af33db039f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:21:06 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:06 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:21:06 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.378s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 1073741824" returned: 0 in 0.718s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Deleted volume successfully. Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd287b49-8609-4251-ab6c-44f69e1bc1ae tempest-ProjectReaderTests-1792160337 None] Lock "cinder-ea99bb4c-8c11-4dd2-903f-4288ff527102-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 Sep 25 16:21:06 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:07 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6" returned: 0 in 0.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af78d1-5cff-40a2-ab83-8b955b9d289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f686633e-e79a-496a-9cb8-9602541d05a6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027fe212-5bc6-4f79-8489-bb362d5d6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Volume volume-f686633e-e79a-496a-9cb8-9602541d05a6 (f686633e-e79a-496a-9cb8-9602541d05a6): created successfully Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027fe212-5bc6-4f79-8489-bb362d5d6a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (a84adad5-ca34-4f74-a49a-90413287a600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1201d180-60cc-4eca-b9ed-3ecc625c3f42 tempest-VolumesListAdminTestJSON-1261104723 None] Created volume successfully. Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (bd863e6a-548f-405a-89ab-837c4b9f4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b24ba3-bf67-40ff-9634-97412cb3d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b24ba3-bf67-40ff-9634-97412cb3d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2072701334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2a158d-efb4-4205-b408-6a4eaf8af971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:09Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fca2ee9-0aaf-4c41-b14b-0931b42d7e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fca2ee9-0aaf-4c41-b14b-0931b42d7e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7863f2-34a4-4f36-b2ee-9445edcfa8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7863f2-34a4-4f36-b2ee-9445edcfa8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2a158d-efb4-4205-b408-6a4eaf8af971', 'volume_name': 'volume-0b2a158d-efb4-4205-b408-6a4eaf8af971', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91f8d50-96be-4254-a491-b5f7b0a29d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91f8d50-96be-4254-a491-b5f7b0a29d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e8dd1-e036-4b05-8518-85882697d6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Volume 0b2a158d-efb4-4205-b408-6a4eaf8af971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2a158d-efb4-4205-b408-6a4eaf8af971', 'volume_size': 1} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2072701334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2a158d-efb4-4205-b408-6a4eaf8af971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c860687dc733485a9040c596d71344c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:09Z,use_quota=True,user_id='d326f26e057c4832a6013a14f98d6af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Creating volume 0b2a158d-efb4-4205-b408-6a4eaf8af971 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:08 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:08 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 1073741824 Sep 25 16:21:08 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:09 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 1073741824" returned: 0 in 0.640s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:09 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 Sep 25 16:21:09 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (d454b6ab-8f99-4af5-9adc-3b698b378308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac24fdd8-f501-4e1f-9ea5-3221d090b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac24fdd8-f501-4e1f-9ea5-3221d090b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596843381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7f55bd-1dcc-494e-87dc-0c766db53abb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:10Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04729890-0c59-429f-8988-202071fcaba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04729890-0c59-429f-8988-202071fcaba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a12ff3-c2d5-4b58-bc44-a11f8b6261b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a12ff3-c2d5-4b58-bc44-a11f8b6261b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7f55bd-1dcc-494e-87dc-0c766db53abb', 'volume_name': 'volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1def6a-df7f-4ef8-96bd-07c8706e8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1def6a-df7f-4ef8-96bd-07c8706e8235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6769b37-77b0-4f17-a542-532b1632395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Volume eb7f55bd-1dcc-494e-87dc-0c766db53abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb', 'volume_size': 1} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:09 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971" returned: 0 in 0.393s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596843381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7f55bd-1dcc-494e-87dc-0c766db53abb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:10Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Creating volume eb7f55bd-1dcc-494e-87dc-0c766db53abb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e8dd1-e036-4b05-8518-85882697d6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2a158d-efb4-4205-b408-6a4eaf8af971', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:09 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb 1073741824 Sep 25 16:21:09 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a827178-cc0e-4468-b7cb-7a9b9bda4605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Volume volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 (0b2a158d-efb4-4205-b408-6a4eaf8af971): created successfully Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a827178-cc0e-4468-b7cb-7a9b9bda4605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Flow 'volume_create_manager' (bd863e6a-548f-405a-89ab-837c4b9f4123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b6140ebf-3107-4b61-9055-c9f4c2e8794a tempest-VolumesListAdminTestJSON-1261104723 None] Created volume successfully. Sep 25 16:21:10 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb 1073741824" returned: 0 in 0.485s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:10 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb Sep 25 16:21:10 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:10 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb" returned: 0 in 0.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6769b37-77b0-4f17-a542-532b1632395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c865d6e9-a6f1-4f1f-8940-f19629d539cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Volume volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb (eb7f55bd-1dcc-494e-87dc-0c766db53abb): created successfully Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c865d6e9-a6f1-4f1f-8940-f19629d539cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (d454b6ab-8f99-4af5-9adc-3b698b378308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-db40f968-08d2-4263-a87e-b4022a0e28ed tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Flow 'volume_create_manager' (552da76c-47db-440a-8995-d32a8aa785ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94cb92c-ad71-4f22-913d-92bc577fbdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94cb92c-ad71-4f22-913d-92bc577fbdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c968387477245a99159199247c4b193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:12Z,use_quota=True,user_id='207b6baaab8a4fb883bdc0385ba71201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f092f2a5-9288-4725-b67d-f8d891af5268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f092f2a5-9288-4725-b67d-f8d891af5268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4bdd28-1dc2-43d1-bd9c-d61fc6e68989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4bdd28-1dc2-43d1-bd9c-d61fc6e68989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d', 'volume_name': 'volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da34a88-761b-42dc-82d8-e2e8601f8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da34a88-761b-42dc-82d8-e2e8601f8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfffa259-5a3b-4e70-b7bd-8a4816fe6e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Volume a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d', 'volume_size': 1} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c968387477245a99159199247c4b193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:12Z,use_quota=True,user_id='207b6baaab8a4fb883bdc0385ba71201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Creating volume a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:12 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d 1073741824 Sep 25 16:21:12 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:12 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d 1073741824" returned: 0 in 0.669s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:12 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d Sep 25 16:21:12 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (53885aef-8b5d-46dc-86d7-583e725470eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0431da55-ab48-49c8-a4bf-46978a8489b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0431da55-ab48-49c8-a4bf-46978a8489b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-244631367',display_name='tempest-VolumesGetTest-Volume-2116695514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd84f78-caf2-4770-8210-374b8d0ad57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:13Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a2e82c-e633-4918-8a53-f0df5044cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a2e82c-e633-4918-8a53-f0df5044cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104c5cf-8769-43f6-a4f8-f651df7fc01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104c5cf-8769-43f6-a4f8-f651df7fc01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd84f78-caf2-4770-8210-374b8d0ad57b', 'volume_name': 'volume-0dd84f78-caf2-4770-8210-374b8d0ad57b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a25377b-a43f-4eba-9e98-4f87a7900654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a25377b-a43f-4eba-9e98-4f87a7900654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6d496b-9b21-4277-b0e7-d2f014ac04f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Volume 0dd84f78-caf2-4770-8210-374b8d0ad57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd84f78-caf2-4770-8210-374b8d0ad57b', 'volume_size': 1} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-244631367',display_name='tempest-VolumesGetTest-Volume-2116695514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd84f78-caf2-4770-8210-374b8d0ad57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:13Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Creating volume 0dd84f78-caf2-4770-8210-374b8d0ad57b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfffa259-5a3b-4e70-b7bd-8a4816fe6e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b 1073741824 Sep 25 16:21:13 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f472abc-6a60-4af6-8f8f-7e128a9f833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Volume volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d (a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d): created successfully Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f472abc-6a60-4af6-8f8f-7e128a9f833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Flow 'volume_create_manager' (552da76c-47db-440a-8995-d32a8aa785ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f3adccea-6d4b-4b1b-839c-e0aa49843cc8 tempest-VolumesListAdminTestJSON-2095298381 None] Created volume successfully. Sep 25 16:21:13 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b 1073741824" returned: 0 in 0.486s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:13 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b Sep 25 16:21:13 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:13 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b" returned: 0 in 0.350s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6d496b-9b21-4277-b0e7-d2f014ac04f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd84f78-caf2-4770-8210-374b8d0ad57b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a91fa46-a0ee-4ff5-9be8-c03fc59b1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Volume volume-0dd84f78-caf2-4770-8210-374b8d0ad57b (0dd84f78-caf2-4770-8210-374b8d0ad57b): created successfully Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a91fa46-a0ee-4ff5-9be8-c03fc59b1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (53885aef-8b5d-46dc-86d7-583e725470eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ed2a3f15-ce30-42b8-9b40-0ce9df03fbf1 tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Acquiring lock "cinder-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "cinder-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Acquiring lock "cinder-quobyte-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "cinder-quobyte-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb49e7-b5a9-464d-a796-c59fd527477f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-0b2a158d-efb4-4205-b408-6a4eaf8af971-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-0b2a158d-efb4-4205-b408-6a4eaf8af971-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-quobyte-0b2a158d-efb4-4205-b408-6a4eaf8af971" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-0b2a158d-efb4-4205-b408-6a4eaf8af971" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:14 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d Sep 25 16:21:14 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb12ed-815d-4a78-ab74-ab795fc76ceb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:14 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 Sep 25 16:21:14 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:14 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" returned: 0 in 0.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:14 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d Sep 25 16:21:14 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:14 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:15 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971 Sep 25 16:21:15 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" returned: 0 in 0.393s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "cinder-quobyte-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d" released by "delete_volume" :: held 0.983s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Created reservations ['c53b958b-e35b-4c91-8d46-c32409b7353f', '6ba980eb-d135-4446-bc15-d8b730fd62c2', '0e96e090-ef08-4c36-9693-62fdaa716898', '8bae0681-7f19-4862-b10e-5505a32738c4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:15 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-0dd84f78-caf2-4770-8210-374b8d0ad57b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0b2a158d-efb4-4205-b408-6a4eaf8af971" returned: 0 in 0.363s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "cinder-0dd84f78-caf2-4770-8210-374b8d0ad57b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-0b2a158d-efb4-4205-b408-6a4eaf8af971" released by "delete_volume" :: held 0.963s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-0dd84f78-caf2-4770-8210-374b8d0ad57b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-0dd84f78-caf2-4770-8210-374b8d0ad57b" acquired by "delete_volume" :: waited 0.075s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:15 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:15 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ee7da-50f5-42fa-93af-5a07bc9f1346]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Created reservations ['ea28c732-eecc-4568-8767-32ab6a7d8f35', '1c741e66-3c1b-467a-9b05-4fecbdb97869', 'b8ee20da-2ff7-47f9-ab99-8bf00aea379a', '5b1d1c2c-7712-40a5-84bd-bc2d25378665'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:15 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b Sep 25 16:21:15 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:15 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.412s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Deleted volume successfully. Sep 25 16:21:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a875d6a0-7352-41c8-90db-a5798a4e840c tempest-VolumesListAdminTestJSON-2095298381 None] Lock "cinder-a2cf8697-9d5a-4360-9b0f-f5b7ccd02c4d-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:16 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.325s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Deleted volume successfully. Sep 25 16:21:16 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b" returned: 0 in 0.539s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-520ff86c-e7c4-4f5a-8ac8-74c6e5cbcb28 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-0b2a158d-efb4-4205-b408-6a4eaf8af971-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:16 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b Sep 25 16:21:16 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:16 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0dd84f78-caf2-4770-8210-374b8d0ad57b" returned: 0 in 0.265s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-0dd84f78-caf2-4770-8210-374b8d0ad57b" released by "delete_volume" :: held 0.877s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Created reservations ['771007ac-8586-4439-88a3-787d1e07be26', 'ab8925d6-fcbd-40b3-8af7-562b3d77d0ba', '89a1c2d1-6d77-497f-b025-6646d9ea0984', 'f3163331-5dcd-4d1b-a5cd-09b614b9fea9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:16 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:16 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-f686633e-e79a-496a-9cb8-9602541d05a6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-f686633e-e79a-496a-9cb8-9602541d05a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-quobyte-f686633e-e79a-496a-9cb8-9602541d05a6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-f686633e-e79a-496a-9cb8-9602541d05a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b3ccbf-4c8c-4908-81f3-ca2cf6aeffec]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:16 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0360b979-ae09-467a-9f24-7afa180800a6 tempest-VolumesGetTest-1401763368 None] Lock "cinder-0dd84f78-caf2-4770-8210-374b8d0ad57b-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:17 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 Sep 25 16:21:17 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:17 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6" returned: 0 in 0.535s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:17 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6 Sep 25 16:21:17 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-eb7f55bd-1dcc-494e-87dc-0c766db53abb-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "cinder-eb7f55bd-1dcc-494e-87dc-0c766db53abb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-eb7f55bd-1dcc-494e-87dc-0c766db53abb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:17 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f686633e-e79a-496a-9cb8-9602541d05a6" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-eb7f55bd-1dcc-494e-87dc-0c766db53abb" acquired by "delete_volume" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-f686633e-e79a-496a-9cb8-9602541d05a6" released by "delete_volume" :: held 1.029s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a111c5c-5642-45b0-aade-670cef0d24a4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Created reservations ['edc276f1-5e79-49e2-a208-cce34ba84d9d', '60a82d1c-ff46-460d-a3ff-d9f10a54bf98', '36940370-3559-470b-8678-bb88013d9adc', '30dfc530-d341-4625-840e-2b07aa730846'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:18 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb Sep 25 16:21:18 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:18 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:18 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:18 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb" returned: 0 in 0.483s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:18 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.340s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Deleted volume successfully. Sep 25 16:21:18 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb Sep 25 16:21:18 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29a95b64-d04e-4452-a712-f1c8d3eab844 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-f686633e-e79a-496a-9cb8-9602541d05a6-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:18 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-eb7f55bd-1dcc-494e-87dc-0c766db53abb" returned: 0 in 0.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-eb7f55bd-1dcc-494e-87dc-0c766db53abb" released by "delete_volume" :: held 0.880s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Created reservations ['55f2c591-5450-432b-b073-e463de64b186', '2eea8cc9-4c6f-4123-96b1-2075786bdb92', 'f4e918d4-0366-4993-b5a6-ee9a09f2e631', '01a67bdf-7a7d-44af-aba9-f35b2cd91cc8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:18 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:18 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-6168f48f-9801-4f67-bd67-7526174f21e8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-6168f48f-9801-4f67-bd67-7526174f21e8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "cinder-quobyte-6168f48f-9801-4f67-bd67-7526174f21e8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-6168f48f-9801-4f67-bd67-7526174f21e8" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:19 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.510s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ef616a-2f7b-4590-b01e-b8cd4f854292]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ed88fde7-fe49-4685-865f-8a2947591f3e tempest-VolumesGetTest-1401763368 None] Lock "cinder-eb7f55bd-1dcc-494e-87dc-0c766db53abb-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:19 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 Sep 25 16:21:19 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (525758b6-8ac4-4bb4-8d6a-dab902b45c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b5366-2687-41ce-afba-bf905de98b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b5366-2687-41ce-afba-bf905de98b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577445634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:20Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fa7a08-5ff9-45f7-a835-71509457e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fa7a08-5ff9-45f7-a835-71509457e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc30858-d670-43fb-8297-4210f78180c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc30858-d670-43fb-8297-4210f78180c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'volume_name': 'volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083453a6-e1c6-439c-9a01-f42280fb25aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083453a6-e1c6-439c-9a01-f42280fb25aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb917c-4b3f-4ab5-a487-e16328f7156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Volume f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'volume_size': 1} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577445634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:20Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Creating volume f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:19 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e 1073741824 Sep 25 16:21:19 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:20 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8" returned: 0 in 0.560s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:20 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8 Sep 25 16:21:20 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:20 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6168f48f-9801-4f67-bd67-7526174f21e8" returned: 0 in 0.318s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-quobyte-6168f48f-9801-4f67-bd67-7526174f21e8" released by "delete_volume" :: held 0.987s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Created reservations ['aa6efb6f-56df-4ed4-8351-634c681d581d', 'bf8d6ff4-9446-41f3-8adb-e5f026527314', '8c174f6a-50e7-48c8-85ef-8761fa375e61', '2b0950b3-a575-4aed-82f0-875cbd913c5f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:20 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e 1073741824" returned: 0 in 0.714s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:20 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:20 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:20 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:20 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:21 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.383s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Deleted volume successfully. Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9092480c-535a-47e3-a6a6-dbc329880cf4 tempest-VolumesListAdminTestJSON-1261104723 None] Lock "cinder-6168f48f-9801-4f67-bd67-7526174f21e8-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:21 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb917c-4b3f-4ab5-a487-e16328f7156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb171d5-700f-42cd-aae7-bbc198e18cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Volume volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e (f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e): created successfully Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb171d5-700f-42cd-aae7-bbc198e18cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (525758b6-8ac4-4bb4-8d6a-dab902b45c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a0322181-ae10-4f40-861f-141f15298a89 tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (3e68c96f-6fcc-4dff-8eca-3dbbb697b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543404b7-0d26-4b54-a95b-3e3072051ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543404b7-0d26-4b54-a95b-3e3072051ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1971071632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09ee881-5314-4b4b-a8bf-da5ec669a8ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:23Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a210e8be-2967-4680-86d1-7d0d761cbc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a210e8be-2967-4680-86d1-7d0d761cbc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c5d342-6375-45f6-88d4-7dece5ee535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c5d342-6375-45f6-88d4-7dece5ee535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c09ee881-5314-4b4b-a8bf-da5ec669a8ca', 'volume_name': 'volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca', 'volume_size': 1, 'source_volid': 'f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae914b9-1644-40ac-b0f8-a1647f6754a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae914b9-1644-40ac-b0f8-a1647f6754a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09714df1-5835-45d0-b170-1ffd8d25b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Volume c09ee881-5314-4b4b-a8bf-da5ec669a8ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca', 'volume_size': 1, 'source_volid': 'f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'source_volstatus': 'available'} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:22 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Cloning volume f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e to volume c09ee881-5314-4b4b-a8bf-da5ec669a8ca Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Creating offline snapshot d5851372-cb4b-4c53-a9fb-e22716d244d6 of volume f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f077a332-411f-4244-bd4e-2bb2dffec3d6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:23 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:23 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:23 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.561s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:23 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 1G Sep 25 16:21:23 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:24 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 1G" returned: 0 in 0.627s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:24 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:24 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:24 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.398s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:24 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 is being set with open permissions: ugo+rw Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:24 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:24 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:24 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:24 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info Sep 25 16:21:24 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:25 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info" returned: 0 in 0.423s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info is being set with open permissions: ugo+rw Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:25 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info Sep 25 16:21:25 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:25 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.info" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] snapshot: d5851372-cb4b-4c53-a9fb-e22716d244d6, volume: c09ee881-5314-4b4b-a8bf-da5ec669a8ca, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c632ace-f284-4c42-86af-70cbe92751e5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:25 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:25 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:26 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.473s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9622ac53-25b3-4839-a361-659198074f09]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:26 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:26 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:26 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:26 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca Sep 25 16:21:26 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:34 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=128,cinder:SELECT=98,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:34 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=80,cinder:UPDATE=139,cinder:DELETE=16,cinder:INSERT=30 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:36 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" returned: 0 in 9.305s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:21:36 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Converted 1024.00 MB image at 110.04 MB/s Sep 25 16:21:36 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca is being set with open permissions: ugo+rw Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca Sep 25 16:21:36 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:36 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" returned: 0 in 0.403s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" released by "_copy_volume_from_snapshot" :: held 10.771s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-d5851372-cb4b-4c53-a9fb-e22716d244d6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-d5851372-cb4b-4c53-a9fb-e22716d244d6" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Deleting offline snapshot d5851372-cb4b-4c53-a9fb-e22716d244d6 of volume f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] snapshot_file for this snap is: volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[93448f9f-b859-4844-9650-734a214856d6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:36 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:37 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.728s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184900c-f2ab-4df8-b166-defa95667fdd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:37 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:37 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:38 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:38 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:38 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:38 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.518s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:38 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6 Sep 25 16:21:38 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:38 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e.d5851372-cb4b-4c53-a9fb-e22716d244d6" returned: 0 in 0.374s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-d5851372-cb4b-4c53-a9fb-e22716d244d6" released by "_delete_snapshot" :: held 2.508s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.269s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09714df1-5835-45d0-b170-1ffd8d25b453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca', 'volume_size': 1, 'source_volid': 'f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bc3019-decf-4297-912c-1f09d7be3f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Volume volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca (c09ee881-5314-4b4b-a8bf-da5ec669a8ca): created successfully Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bc3019-decf-4297-912c-1f09d7be3f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (3e68c96f-6fcc-4dff-8eca-3dbbb697b72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a2930d25-7a54-4e91-ac80-62b26475a36e tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (6582d19e-ffd7-455b-bb05-b4565da0fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b08e51-a146-4234-a35c-56e81c0c4658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b08e51-a146-4234-a35c-56e81c0c4658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-909407774',display_name='tempest-VolumesGetTest-Volume-1341375937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e1908-139d-4216-9d50-0ddbbc403cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:40Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19c8f7a-8eec-4abe-a11c-04c5a3a6c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19c8f7a-8eec-4abe-a11c-04c5a3a6c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc982ac-60bd-45ac-9ded-4a4283ccfe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc982ac-60bd-45ac-9ded-4a4283ccfe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1e1908-139d-4216-9d50-0ddbbc403cc4', 'volume_name': 'volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697c7673-7a1c-40ef-8b27-d2be6d10bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697c7673-7a1c-40ef-8b27-d2be6d10bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6796571c-4142-4a89-895e-6a3e25798df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Volume ec1e1908-139d-4216-9d50-0ddbbc403cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4', 'volume_size': 1} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-909407774',display_name='tempest-VolumesGetTest-Volume-1341375937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e1908-139d-4216-9d50-0ddbbc403cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:40Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Creating volume ec1e1908-139d-4216-9d50-0ddbbc403cc4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:40 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 1073741824 Sep 25 16:21:40 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Flow 'volume_create_manager' (f179257c-4e16-45b2-89cd-bf47e3af4f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737570df-0767-4306-92c1-c5cf04dd1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737570df-0767-4306-92c1-c5cf04dd1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1002332892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c5816-2415-440f-9241-9dd484a197b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6820ea9e61dc495687b97a6bbad37a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:41Z,use_quota=True,user_id='b5abde5c9a654e108826da0c1f055be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63abbd6b-6848-4cab-8bc9-368cf97c168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63abbd6b-6848-4cab-8bc9-368cf97c168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76dc6f-a3c8-480d-b2f2-621624c26be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76dc6f-a3c8-480d-b2f2-621624c26be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3c5816-2415-440f-9241-9dd484a197b2', 'volume_name': 'volume-1d3c5816-2415-440f-9241-9dd484a197b2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443f394-55ad-4a4f-b98c-e8db980b4178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443f394-55ad-4a4f-b98c-e8db980b4178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34442bf6-398e-47e9-84ff-7e1a85bb5c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Volume 1d3c5816-2415-440f-9241-9dd484a197b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3c5816-2415-440f-9241-9dd484a197b2', 'volume_size': 1} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:41 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 1073741824" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:41 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 Sep 25 16:21:41 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:41 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1002332892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c5816-2415-440f-9241-9dd484a197b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6820ea9e61dc495687b97a6bbad37a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:41Z,use_quota=True,user_id='b5abde5c9a654e108826da0c1f055be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Creating volume 1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:41 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 1073741824 Sep 25 16:21:41 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6796571c-4142-4a89-895e-6a3e25798df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37347355-269a-4623-867a-a754addd0cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Volume volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 (ec1e1908-139d-4216-9d50-0ddbbc403cc4): created successfully Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37347355-269a-4623-867a-a754addd0cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (6582d19e-ffd7-455b-bb05-b4565da0fc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f2a489b6-8c65-4830-91ab-b6ac0f0b092f tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:21:42 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 1073741824" returned: 0 in 0.538s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:42 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:21:42 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:42 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34442bf6-398e-47e9-84ff-7e1a85bb5c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3c5816-2415-440f-9241-9dd484a197b2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a8491-cbf6-41c8-a121-8bb48c59f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Volume volume-1d3c5816-2415-440f-9241-9dd484a197b2 (1d3c5816-2415-440f-9241-9dd484a197b2): created successfully Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a8491-cbf6-41c8-a121-8bb48c59f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Flow 'volume_create_manager' (f179257c-4e16-45b2-89cd-bf47e3af4f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-072e5d4f-f86d-4c26-9220-6af65eb6a6fa tempest-SnapshotDependencyTests-227854503 None] Created volume successfully. Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-ec1e1908-139d-4216-9d50-0ddbbc403cc4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "cinder-ec1e1908-139d-4216-9d50-0ddbbc403cc4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-ec1e1908-139d-4216-9d50-0ddbbc403cc4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-ec1e1908-139d-4216-9d50-0ddbbc403cc4" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd30a33-5467-4ab8-9fbd-d26d2fdc301b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:43 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 Sep 25 16:21:43 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:43 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4" returned: 0 in 0.509s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:43 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4 Sep 25 16:21:43 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Creating offline snapshot 6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 of volume 1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[58334b22-a63b-4f93-bf97-a42cab1946a6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:43 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:21:43 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:43 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ec1e1908-139d-4216-9d50-0ddbbc403cc4" returned: 0 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-ec1e1908-139d-4216-9d50-0ddbbc403cc4" released by "delete_volume" :: held 0.920s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Created reservations ['0a474967-db80-497f-a93a-1f60f7a4a25e', '648988df-4c11-4d87-97ee-da28eeb8a3a0', '055c0431-4c20-404d-be38-647498dc57b9', '8001c9dc-6c47-4281-a0f8-ba90677367d3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:44 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.500s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 1G Sep 25 16:21:44 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-c09ee881-5314-4b4b-a8bf-da5ec669a8ca-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "cinder-c09ee881-5314-4b4b-a8bf-da5ec669a8ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69a8993-1e5e-48a4-b2da-1be255bd761b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1e912802-90ce-45b5-96fd-bf841b3a6a1e tempest-VolumesGetTest-1401763368 None] Lock "cinder-ec1e1908-139d-4216-9d50-0ddbbc403cc4-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:44 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca Sep 25 16:21:44 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 1G" returned: 0 in 0.650s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3c5816-2415-440f-9241-9dd484a197b2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3c5816-2415-440f-9241-9dd484a197b2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:44 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca Sep 25 16:21:44 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:45 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3c5816-2415-440f-9241-9dd484a197b2 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.365s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 is being set with open permissions: ugo+rw Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:45 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:45 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:45 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" returned: 0 in 0.339s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-c09ee881-5314-4b4b-a8bf-da5ec669a8ca" released by "delete_volume" :: held 0.915s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Created reservations ['41328c8e-581a-4942-a66b-4d1192b30756', '0f15020f-4a16-4006-8edd-59d65ca23126', '319288c2-f3bd-4888-9bfb-b06d61f33391', '2cd942c7-5588-43e8-8604-105c7808754b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:45 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:45 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:45 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.343s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:45 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info Sep 25 16:21:45 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:45 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.305s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be9b5ecf-3228-46a6-8e71-29eeb580df42 tempest-VolumesGetTest-1401763368 None] Lock "cinder-c09ee881-5314-4b4b-a8bf-da5ec669a8ca-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:45 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info" returned: 0 in 0.317s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info is being set with open permissions: ugo+rw Sep 25 16:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:45 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info Sep 25 16:21:45 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:46 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.info" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1aed329c-b362-4ee6-9a8d-bf3aa47b0164 tempest-SnapshotDependencyTests-227854503 None] Create snapshot completed successfully Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "cinder-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Flow 'volume_create_manager' (599237b0-73d1-4a19-aa7b-45bc32cf0815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2615353f-8408-44bd-9be6-69f7f474811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2615353f-8408-44bd-9be6-69f7f474811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-559864422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179dee99-d230-4813-aa0e-b0e8d8364a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1686f5278ce4a12b610155e731e86aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:47Z,use_quota=True,user_id='07de9787638f480c8a4569102ba8a6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b3f7ac-5ff6-4684-9397-cfaa2df11ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b3f7ac-5ff6-4684-9397-cfaa2df11ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecb1e9c-6c70-4f28-b65e-02f1b577aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecb1e9c-6c70-4f28-b65e-02f1b577aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179dee99-d230-4813-aa0e-b0e8d8364a26', 'volume_name': 'volume-179dee99-d230-4813-aa0e-b0e8d8364a26', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e476d71e-13b1-4406-a41a-0ab4c04a8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e476d71e-13b1-4406-a41a-0ab4c04a8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19305531-c022-4ed9-b2dc-cada5927b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Volume 179dee99-d230-4813-aa0e-b0e8d8364a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179dee99-d230-4813-aa0e-b0e8d8364a26', 'volume_size': 2} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-559864422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179dee99-d230-4813-aa0e-b0e8d8364a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1686f5278ce4a12b610155e731e86aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:47Z,use_quota=True,user_id='07de9787638f480c8a4569102ba8a6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Creating volume 179dee99-d230-4813-aa0e-b0e8d8364a26 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:46 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 2147483648 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" acquired by "delete_volume" :: waited 0.078s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:46 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 2147483648 Sep 25 16:21:46 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c212e0-e550-4a4d-ac05-c9421f53321e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:46 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:46 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:47 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.450s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e Sep 25 16:21:47 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:47 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 2147483648" returned: 0 in 0.639s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 Sep 25 16:21:47 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Flow 'volume_create_manager' (b3fa40c5-b1c4-48e6-9def-581fe9f54d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39dddb6-4fbd-464b-9229-6d84bf451430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39dddb6-4fbd-464b-9229-6d84bf451430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce590f94-e2b3-42e9-81fc-f47b8aee98ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6820ea9e61dc495687b97a6bbad37a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6437f4d4-3b79-4af1-a5ed-25bd3f2c8191,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:47Z,use_quota=True,user_id='b5abde5c9a654e108826da0c1f055be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c58becc-e27c-4847-a464-efb369fc4c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c58becc-e27c-4847-a464-efb369fc4c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e121505b-dfda-4212-9b7e-077a94f8658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e121505b-dfda-4212-9b7e-077a94f8658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce590f94-e2b3-42e9-81fc-f47b8aee98ef', 'volume_name': 'volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef', 'volume_size': 1, 'snapshot_id': '6437f4d4-3b79-4af1-a5ed-25bd3f2c8191'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6987fa-8b8a-449d-9a66-79901d17896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6987fa-8b8a-449d-9a66-79901d17896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39458241-e3d7-4e73-a9f9-9e7f052fc102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Volume ce590f94-e2b3-42e9-81fc-f47b8aee98ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef', 'volume_size': 1, 'snapshot_id': '6437f4d4-3b79-4af1-a5ed-25bd3f2c8191'} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" returned: 0 in 0.352s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e" released by "delete_volume" :: held 0.898s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:47 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.075s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Created reservations ['7fd194d0-3b94-47b1-88ec-4a50e000bebe', '97c89198-b0c8-4928-90f9-680ec5600aff', '7d831c76-6470-44b3-85b6-a60cbac63851', '76717cff-97c2-4687-bcdc-fda58883c232'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19305531-c022-4ed9-b2dc-cada5927b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179dee99-d230-4813-aa0e-b0e8d8364a26', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65cee61-751c-407d-a1d9-0a2992b6279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Creating volume ce590f94-e2b3-42e9-81fc-f47b8aee98ef from snapshot 6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Volume volume-179dee99-d230-4813-aa0e-b0e8d8364a26 (179dee99-d230-4813-aa0e-b0e8d8364a26): created successfully Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65cee61-751c-407d-a1d9-0a2992b6279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Flow 'volume_create_manager' (599237b0-73d1-4a19-aa7b-45bc32cf0815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] snapshot: 6437f4d4-3b79-4af1-a5ed-25bd3f2c8191, volume: ce590f94-e2b3-42e9-81fc-f47b8aee98ef, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:21:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e7425ca6-29fe-448a-be51-21497ef9f9d1 tempest-VolumesCloneNegativeTest-2140930426 None] Created volume successfully. Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2307d-35f7-43d1-9cad-2c1a152a9d13]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:47 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:48 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1d3d8ac-1219-4417-937a-47c10d3d4e08 tempest-VolumesGetTest-1401763368 None] Lock "cinder-f493e33e-3c7e-4fd6-ae72-00cd74cc0f1e-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:48 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.397s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d3c5816-2415-440f-9241-9dd484a197b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5292640-7f37-46d3-a798-3b3b41a8dfa4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:48 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:21:48 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.364s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:48 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef Sep 25 16:21:48 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Acquiring lock "cinder-179dee99-d230-4813-aa0e-b0e8d8364a26-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "cinder-179dee99-d230-4813-aa0e-b0e8d8364a26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Acquiring lock "cinder-quobyte-179dee99-d230-4813-aa0e-b0e8d8364a26" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "cinder-quobyte-179dee99-d230-4813-aa0e-b0e8d8364a26" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0868b044-4e9f-492c-a7f8-637229080f2b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:49 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 Sep 25 16:21:49 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:49 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:49 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26 Sep 25 16:21:49 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:50 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-179dee99-d230-4813-aa0e-b0e8d8364a26" returned: 0 in 0.607s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (5530a781-9972-4b46-b33d-f348422f2df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba0619a-858f-49ab-8731-930161737fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "cinder-quobyte-179dee99-d230-4813-aa0e-b0e8d8364a26" released by "delete_volume" :: held 1.369s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba0619a-858f-49ab-8731-930161737fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1895279073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e82f6aa-987d-4f5b-82d2-dd62806cce7f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:50Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed294f02-6ae8-4ff6-926d-927ffc4fbae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed294f02-6ae8-4ff6-926d-927ffc4fbae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcaa869-66a9-4ec7-94d5-20e5292dfddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Created reservations ['dbfe171f-1626-4589-be1f-d012bd22d091', '0f8a14ec-86d0-48f9-8d0a-0e732f629d8d', 'e53fff17-77db-4059-aa67-392ab3451ef6', 'bde1f4db-c836-4df3-a227-d75e6340aae0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:50 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:21:50 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:51 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.445s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Deleted volume successfully. Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b835e0c0-9caf-4406-9eae-217503c893a8 tempest-VolumesCloneNegativeTest-2140930426 None] Lock "cinder-179dee99-d230-4813-aa0e-b0e8d8364a26-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcaa869-66a9-4ec7-94d5-20e5292dfddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e82f6aa-987d-4f5b-82d2-dd62806cce7f', 'volume_name': 'volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9c13a9-3b93-44ae-9924-a0cb7fadb03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9c13a9-3b93-44ae-9924-a0cb7fadb03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c8f2a6-010d-470a-b042-c2093828ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:21:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Trying to clone 6e82f6aa-987d-4f5b-82d2-dd62806cce7f from image a5d467e0-719a-49cf-b176-4393aa2e5a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:21:52 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[08000470-2c7e-4e84-b25d-3b260b1350cc]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:52 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD Sep 25 16:21:52 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:52 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d is fetched for user bb95d4c142d94a0e9232f92ab67164e2. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[92adfe29-7866-4663-a491-f44db79d6117]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:53 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD Sep 25 16:21:53 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:53 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD" returned: 0 in 0.952s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:55 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" returned: 0 in 7.307s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:21:56 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Converted 1024.00 MB image at 140.12 MB/s Sep 25 16:21:56 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef is being set with open permissions: ugo+rw Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef Sep 25 16:21:56 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:56 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" returned: 0 in 0.276s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" released by "_copy_volume_from_snapshot" :: held 8.453s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" released by "_create_volume_from_snapshot" :: held 8.545s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.586s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.598s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1895279073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e82f6aa-987d-4f5b-82d2-dd62806cce7f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:50Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Creating volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1073741824 Sep 25 16:21:56 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39458241-e3d7-4e73-a9f9-9e7f052fc102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef', 'volume_size': 1, 'snapshot_id': '6437f4d4-3b79-4af1-a5ed-25bd3f2c8191'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9976844-c45d-49c5-94f3-e6f4ff2b87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Volume volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef (ce590f94-e2b3-42e9-81fc-f47b8aee98ef): created successfully Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9976844-c45d-49c5-94f3-e6f4ff2b87a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Flow 'volume_create_manager' (b3fa40c5-b1c4-48e6-9def-581fe9f54d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-42c206b6-627c-431d-bb8a-eb9f2a235a03 tempest-SnapshotDependencyTests-227854503 None] Created volume successfully. Sep 25 16:21:56 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1073741824" returned: 0 in 0.556s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f Sep 25 16:21:56 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:57 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Attempting download of a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9573d8-f112-4e63-823a-4182361ab1bf]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:57 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj Sep 25 16:21:57 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Deleting offline snapshot 6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 of volume 1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] snapshot_file for this snap is: volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430a99e-6095-44ab-aab7-e27958c2878e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:57 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:57 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:57 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:57 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj Sep 25 16:21:57 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.472s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d3c5816-2415-440f-9241-9dd484a197b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92742f2-ac69-4445-89d7-39285e0d13fa]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj" returned: 1 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5d467e0-719a-49cf-b176-4393aa2e5a8d_fzis8lbj' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdbb319-484f-4c6a-b750-0d46f1fae875]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:21:58 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD Sep 25 16:21:58 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] a5d467e0-719a-49cf-b176-4393aa2e5a8d was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f Sep 25 16:21:58 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.578s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:58 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:59 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.418s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:59 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191 Sep 25 16:21:59 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:59 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2.6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191" released by "_delete_snapshot" :: held 1.906s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" released by "delete_snapshot" :: held 1.950s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Created reservations ['e6563c09-3006-462e-9cca-5bf093faa37c', '2ab1b360-d9fb-471a-981e-b7ffdec67d02', '839b87ec-a6c3-4e88-88e5-b9c4fe30fe29', '6697a165-475f-492f-a6ee-cd135491fc04'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Delete snapshot completed successfully. Sep 25 16:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8de6b29-3db4-49ca-ae57-c029f97c5b46 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-6437f4d4-3b79-4af1-a5ed-25bd3f2c8191-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-1d3c5816-2415-440f-9241-9dd484a197b2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-1d3c5816-2415-440f-9241-9dd484a197b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:00 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" returned: 0 in 2.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5d467e0-719a-49cf-b176-4393aa2e5a8d_hnoi1tltdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:22:00 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Converted 112.00 MB image at 49.24 MB/s Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:00 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1G Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:00 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e6950-75a2-43df-aa12-7b52852acc8e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:00 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:22:00 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:01 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f 1G" returned: 0 in 0.370s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Downloaded image a5d467e0-719a-49cf-b176-4393aa2e5a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}])) to volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Temporary image a5d467e0-719a-49cf-b176-4393aa2e5a8d for user bb95d4c142d94a0e9232f92ab67164e2 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Marking volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Copying metadata from image a5d467e0-719a-49cf-b176-4393aa2e5a8d to 6e82f6aa-987d-4f5b-82d2-dd62806cce7f. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Creating volume glance metadata for volume 6e82f6aa-987d-4f5b-82d2-dd62806cce7f backed by image a5d467e0-719a-49cf-b176-4393aa2e5a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:22:01 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.444s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:01 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2 Sep 25 16:22:01 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c8f2a6-010d-470a-b042-c2093828ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f', 'volume_size': 1, 'image_id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c777582008a3467bb746936886f11eee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5d467e0-719a-49cf-b176-4393aa2e5a8d', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5d467e0-719a-49cf-b176-4393aa2e5a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a64ba8-b91a-4d97-8e7f-1f20587a8bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Volume volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f (6e82f6aa-987d-4f5b-82d2-dd62806cce7f): created successfully Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a64ba8-b91a-4d97-8e7f-1f20587a8bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (5530a781-9972-4b46-b33d-f348422f2df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-15663e63-2b2d-47ad-a7f8-fa4f08648a92 tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:22:01 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1d3c5816-2415-440f-9241-9dd484a197b2" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-1d3c5816-2415-440f-9241-9dd484a197b2" released by "delete_volume" :: held 0.949s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Created reservations ['1050e25c-6fe9-4745-b340-04f6cbe11e82', '7a2dca7e-e5f8-48b7-9d8a-43d1ba991a39', 'eee438ba-f268-4240-a5d3-5c468694e56b', '32c8f8a8-d081-4cf9-816d-59e9361be9e3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:01 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:01 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:02 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.281s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Deleted volume successfully. Sep 25 16:22:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-acf06309-4a91-425f-99ce-17296c0f57ff tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-1d3c5816-2415-440f-9241-9dd484a197b2-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-ce590f94-e2b3-42e9-81fc-f47b8aee98ef-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-ce590f94-e2b3-42e9-81fc-f47b8aee98ef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d0dff-0368-4798-84ac-6db9e509dec2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (adf58dc8-c683-499c-a22a-5f7258e1eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262d1fe1-d88d-433a-9f32-ec6465c11b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262d1fe1-d88d-433a-9f32-ec6465c11b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903936286',display_name='tempest-VolumesGetTest-Volume-2007023331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b605e5cc-5012-4695-b009-74a560adccda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:03Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20cbf4-18b8-4c8e-86b0-5f5a6940428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20cbf4-18b8-4c8e-86b0-5f5a6940428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369c62ef-960d-41ae-ba4c-f150130f1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369c62ef-960d-41ae-ba4c-f150130f1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b605e5cc-5012-4695-b009-74a560adccda', 'volume_name': 'volume-b605e5cc-5012-4695-b009-74a560adccda', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea1f631-e737-4614-948a-267af761053a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea1f631-e737-4614-948a-267af761053a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777cfaf3-d4ec-48b0-bbe3-99e8aaabf3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Volume b605e5cc-5012-4695-b009-74a560adccda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b605e5cc-5012-4695-b009-74a560adccda', 'volume_size': 1} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903936286',display_name='tempest-VolumesGetTest-Volume-2007023331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b605e5cc-5012-4695-b009-74a560adccda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff03b7f2d9465190aeb7e540946213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:03Z,use_quota=True,user_id='bb95d4c142d94a0e9232f92ab67164e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Creating volume b605e5cc-5012-4695-b009-74a560adccda {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:03 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef Sep 25 16:22:03 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:03 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda 1073741824 Sep 25 16:22:03 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:03 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" returned: 0 in 0.478s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:03 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef Sep 25 16:22:03 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:03 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda 1073741824" returned: 0 in 0.602s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda Sep 25 16:22:04 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-quobyte-ce590f94-e2b3-42e9-81fc-f47b8aee98ef" released by "delete_volume" :: held 0.874s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Created reservations ['73f914fb-944a-4c1b-921e-e49d7122af27', '3e05c93a-8f58-4181-969e-70079293454a', '0ff3f5a7-e042-4016-ae50-bbd34e455e08', 'd32d9c31-9117-435f-951d-29d1f193d6c6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:04 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:04 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda" returned: 0 in 0.475s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777cfaf3-d4ec-48b0-bbe3-99e8aaabf3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b605e5cc-5012-4695-b009-74a560adccda', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2781a582-0f3d-4b55-a559-42bfb960eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Volume volume-b605e5cc-5012-4695-b009-74a560adccda (b605e5cc-5012-4695-b009-74a560adccda): created successfully Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2781a582-0f3d-4b55-a559-42bfb960eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Flow 'volume_create_manager' (adf58dc8-c683-499c-a22a-5f7258e1eeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c0c7ec14-f750-43fb-ba83-160707f832b6 tempest-VolumesGetTest-1401763368 None] Created volume successfully. Sep 25 16:22:04 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Deleted volume successfully. Sep 25 16:22:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-235b054c-1469-4942-955e-3966018a4e20 tempest-SnapshotDependencyTests-227854503 None] Lock "cinder-ce590f94-e2b3-42e9-81fc-f47b8aee98ef-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-b605e5cc-5012-4695-b009-74a560adccda-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "cinder-b605e5cc-5012-4695-b009-74a560adccda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-b605e5cc-5012-4695-b009-74a560adccda" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-b605e5cc-5012-4695-b009-74a560adccda" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[16577cef-7c59-44ac-862d-27dda4378fff]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:05 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda Sep 25 16:22:05 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:06 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:06 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda Sep 25 16:22:06 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:06 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:06 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:06 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.341s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:06 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b605e5cc-5012-4695-b009-74a560adccda" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-b605e5cc-5012-4695-b009-74a560adccda" released by "delete_volume" :: held 0.941s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Created reservations ['a93c9980-4130-4a41-96cb-96437f7abe04', '5f748568-c841-43eb-9c7b-81df577e7d7a', '834a923f-2e35-4af9-aab2-9a88393a3ef9', 'dbafdc75-9c46-4cb2-be55-34675a0c025b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:06 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:06 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:07 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-879f811a-6728-40fc-8110-eaae5b704131 tempest-VolumesGetTest-1401763368 None] Lock "cinder-b605e5cc-5012-4695-b009-74a560adccda-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-6e82f6aa-987d-4f5b-82d2-dd62806cce7f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "cinder-6e82f6aa-987d-4f5b-82d2-dd62806cce7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Acquiring lock "cinder-quobyte-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a7acc-272f-4f8d-be0b-9852ad7ffa30]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f Sep 25 16:22:08 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:08 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f Sep 25 16:22:08 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:08 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" returned: 0 in 0.268s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "cinder-quobyte-6e82f6aa-987d-4f5b-82d2-dd62806cce7f" released by "delete_volume" :: held 0.771s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Created reservations ['10169285-6631-4415-892d-1beb5132c3b8', '2512b0b6-596b-481e-a0c3-5bd8a1fc7175', '062ab67c-fcee-4929-b41b-4366acd33b5b', 'b9510106-166c-457b-a72e-87b40270ec51'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:08 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:09 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.371s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Deleted volume successfully. Sep 25 16:22:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4d8f0c86-d764-45ff-a732-988a82101dfc tempest-VolumesGetTest-1401763368 None] Lock "cinder-6e82f6aa-987d-4f5b-82d2-dd62806cce7f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (97464a0d-4b50-4146-90f5-04ed72fa7503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5c9fe5-f6c9-47ad-9b26-1479f786cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5c9fe5-f6c9-47ad-9b26-1479f786cd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-197739521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858c0124-540b-49d6-8c83-5658d1e72c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:12Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd56ae9-1a4d-4186-ad9d-9cbde40dfb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd56ae9-1a4d-4186-ad9d-9cbde40dfb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af323802-90b1-4f59-9bcb-8f2e0db7efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af323802-90b1-4f59-9bcb-8f2e0db7efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858c0124-540b-49d6-8c83-5658d1e72c8f', 'volume_name': 'volume-858c0124-540b-49d6-8c83-5658d1e72c8f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418be8b-4bb8-4cc2-916c-e0d3ddc5597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418be8b-4bb8-4cc2-916c-e0d3ddc5597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c0e2c-2f56-46a1-9711-b59dc47dadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Volume 858c0124-540b-49d6-8c83-5658d1e72c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858c0124-540b-49d6-8c83-5658d1e72c8f', 'volume_size': 1} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-197739521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858c0124-540b-49d6-8c83-5658d1e72c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:12Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Creating volume 858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:12 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:12 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f 1073741824 Sep 25 16:22:12 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:12 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f 1073741824" returned: 0 in 0.555s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:12 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f Sep 25 16:22:12 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:13 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f" returned: 0 in 0.340s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c0e2c-2f56-46a1-9711-b59dc47dadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858c0124-540b-49d6-8c83-5658d1e72c8f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7f9a5-c2ef-4aac-a5eb-e21e4116439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Volume volume-858c0124-540b-49d6-8c83-5658d1e72c8f (858c0124-540b-49d6-8c83-5658d1e72c8f): created successfully Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7f9a5-c2ef-4aac-a5eb-e21e4116439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (97464a0d-4b50-4146-90f5-04ed72fa7503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6cbbb6f7-cf09-47c8-affe-df1b18b60e49 tempest-VolumesSnapshotTestJSON-767908275 None] Created volume successfully. Sep 25 16:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Creating offline snapshot 0cffb028-252b-497b-a215-e43c81370bad of volume 858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e69c7-ee6c-4890-a4a9-3461e8e84d92]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:14 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f Sep 25 16:22:14 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f" returned: 0 in 0.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad 1G Sep 25 16:22:15 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad 1G" returned: 0 in 0.589s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858c0124-540b-49d6-8c83-5658d1e72c8f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858c0124-540b-49d6-8c83-5658d1e72c8f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad Sep 25 16:22:15 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:16 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858c0124-540b-49d6-8c83-5658d1e72c8f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad" returned: 0 in 0.366s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:16 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad is being set with open permissions: ugo+rw Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:16 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad Sep 25 16:22:16 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:16 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:16 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info Sep 25 16:22:16 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:16 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info" returned: 0 in 0.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:16 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info is being set with open permissions: ugo+rw Sep 25 16:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:16 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info Sep 25 16:22:16 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:17 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.info" returned: 0 in 0.313s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d6ca4f5-e14b-499b-884e-583dfe171540 tempest-VolumesSnapshotTestJSON-767908275 None] Create snapshot completed successfully Sep 25 16:22:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-0cffb028-252b-497b-a215-e43c81370bad-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-0cffb028-252b-497b-a215-e43c81370bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-0cffb028-252b-497b-a215-e43c81370bad" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-0cffb028-252b-497b-a215-e43c81370bad" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Deleting offline snapshot 0cffb028-252b-497b-a215-e43c81370bad of volume 858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] snapshot_file for this snap is: volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23eac8-8f2c-42fd-a518-f65b141def84]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:18 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad Sep 25 16:22:18 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:18 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad" returned: 0 in 0.480s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-858c0124-540b-49d6-8c83-5658d1e72c8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[80581e12-4463-4771-ae85-f7b1acbf66a1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:18 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f Sep 25 16:22:18 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f" returned: 0 in 0.526s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad Sep 25 16:22:19 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Flow 'volume_create_manager' (c9b77886-3ed8-4cf2-88c8-20aad502d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb081d64-52e9-4062-bcf7-e92eb46cee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb081d64-52e9-4062-bcf7-e92eb46cee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1436407425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71396929-92ad-4b20-9bf9-ba08c27b7970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5e424792084e638f7b8705173ffc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:19Z,use_quota=True,user_id='dfc46337993c4fe9bd897489f2fa9800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165790c1-cfc3-4359-8ed0-51cf37003b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165790c1-cfc3-4359-8ed0-51cf37003b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28296328-7bb0-4422-87fa-4d1750276f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28296328-7bb0-4422-87fa-4d1750276f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71396929-92ad-4b20-9bf9-ba08c27b7970', 'volume_name': 'volume-71396929-92ad-4b20-9bf9-ba08c27b7970', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60ceb5a-22b2-4fcb-a240-5d730cbbd28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60ceb5a-22b2-4fcb-a240-5d730cbbd28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b35874-8556-4b09-b396-e9e4b3af7eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Volume 71396929-92ad-4b20-9bf9-ba08c27b7970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71396929-92ad-4b20-9bf9-ba08c27b7970', 'volume_size': 1} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1436407425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71396929-92ad-4b20-9bf9-ba08c27b7970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5e424792084e638f7b8705173ffc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:19Z,use_quota=True,user_id='dfc46337993c4fe9bd897489f2fa9800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Creating volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 1073741824 Sep 25 16:22:19 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad" returned: 0 in 0.395s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad Sep 25 16:22:19 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f.0cffb028-252b-497b-a215-e43c81370bad" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 1073741824" returned: 0 in 0.480s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-0cffb028-252b-497b-a215-e43c81370bad" released by "_delete_snapshot" :: held 1.857s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" released by "delete_snapshot" :: held 1.894s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 Sep 25 16:22:20 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['486fdd43-4cac-464e-adf9-88931ae4d003', '8a1dfe6a-2aa6-411c-b650-be06925afc6f', '6f1e274f-0d85-41db-bd3e-5ec8f81e805e', 'bf842263-1b08-40a6-bc84-1242a3de3ab5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Delete snapshot completed successfully. Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-161444f7-3773-40a6-9d4e-a3c54755e08d tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-0cffb028-252b-497b-a215-e43c81370bad-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:20 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970" returned: 0 in 0.283s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b35874-8556-4b09-b396-e9e4b3af7eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71396929-92ad-4b20-9bf9-ba08c27b7970', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351ffb8d-4e12-40ec-a1a7-5689f1265b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Volume volume-71396929-92ad-4b20-9bf9-ba08c27b7970 (71396929-92ad-4b20-9bf9-ba08c27b7970): created successfully Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351ffb8d-4e12-40ec-a1a7-5689f1265b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Flow 'volume_create_manager' (c9b77886-3ed8-4cf2-88c8-20aad502d028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-150bdfe9-40bf-4edc-9f75-58be35de092d tempest-VolumesSnapshotListTestJSON-1158185595 None] Created volume successfully. Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (856180df-2012-42ea-9151-9d97f4b4d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7550a0-76c5-4758-be2d-9d23a2163ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7550a0-76c5-4758-be2d-9d23a2163ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-520530992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953cea4d-ba3c-4e3d-896f-c7362b5f267d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:21Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e64445d-d5ab-4041-8fa4-60708b8c22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e64445d-d5ab-4041-8fa4-60708b8c22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a040c5a0-e74b-44bb-932b-1d54ee4ecb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a040c5a0-e74b-44bb-932b-1d54ee4ecb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953cea4d-ba3c-4e3d-896f-c7362b5f267d', 'volume_name': 'volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3007921-4be1-4783-9909-1bed85c4fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3007921-4be1-4783-9909-1bed85c4fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdab384-7835-4aea-a4cc-6d56d9ccd537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Volume 953cea4d-ba3c-4e3d-896f-c7362b5f267d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d', 'volume_size': 1} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-520530992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953cea4d-ba3c-4e3d-896f-c7362b5f267d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:21Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Creating volume 953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:20 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d 1073741824 Sep 25 16:22:20 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:21 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d 1073741824" returned: 0 in 0.493s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:21 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:21 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:21 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.070s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Creating offline snapshot f4497f87-7947-4d4f-a2bc-daa825d4e374 of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdab384-7835-4aea-a4cc-6d56d9ccd537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7fd86d-5b3e-4566-9398-2c06db845b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13666b8-3156-461b-9fe4-d61f5037dad3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Volume volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d (953cea4d-ba3c-4e3d-896f-c7362b5f267d): created successfully Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7fd86d-5b3e-4566-9398-2c06db845b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (856180df-2012-42ea-9151-9d97f4b4d362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e9adb4d0-74af-4c46-8a4d-a7650b30b80a tempest-VolumesSnapshotTestJSON-767908275 None] Created volume successfully. Sep 25 16:22:21 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 Sep 25 16:22:21 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:22 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:22 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 1G Sep 25 16:22:22 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:22 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 1G" returned: 0 in 0.485s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:22 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:22 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 is being set with open permissions: ugo+rw Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:23 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:23 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:23 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.304s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:23 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info Sep 25 16:22:23 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info is being set with open permissions: ugo+rw Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:23 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info Sep 25 16:22:23 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.info" returned: 0 in 0.251s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.775s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Creating offline snapshot 4ee7cddb-dce1-4ac9-b362-3c79a873cf43 of volume 953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c7b02638-13fa-4e0c-864e-ad4938652ae2 tempest-VolumesSnapshotListTestJSON-1158185595 None] Create snapshot completed successfully Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf128a3-f1d1-4bf7-ac3d-513c8933aced]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:24 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:24 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:24 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:24 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 1G Sep 25 16:22:24 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:24 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 1G" returned: 0 in 0.436s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:24 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:24 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 is being set with open permissions: ugo+rw Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:25 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info Sep 25 16:22:25 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info" returned: 0 in 0.263s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info is being set with open permissions: ugo+rw Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info Sep 25 16:22:25 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.info" returned: 0 in 0.252s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.924s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Creating offline snapshot cb571a50-c3a3-4d9f-9820-78d8eb793d41 of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a1721-1303-4893-a694-bf1c002b9287]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6454a42-b949-4612-9690-2c7a3c6620a5 tempest-VolumesSnapshotTestJSON-767908275 None] Create snapshot completed successfully Sep 25 16:22:26 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:26 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:26 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 1G Sep 25 16:22:26 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (ca1a921c-f5b9-4473-a9e5-b55e40cb9d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0c1c2c-ec51-4462-bf07-1ee37bca829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0c1c2c-ec51-4462-bf07-1ee37bca829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1076778399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551f5dba-85df-4a39-b27a-3595f556088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4ee7cddb-dce1-4ac9-b362-3c79a873cf43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:27Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc119f7-1564-4e2b-ac69-e4e862b8ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc119f7-1564-4e2b-ac69-e4e862b8ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5858df-fe97-4109-95c7-6b62e3b678e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5858df-fe97-4109-95c7-6b62e3b678e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '551f5dba-85df-4a39-b27a-3595f556088b', 'volume_name': 'volume-551f5dba-85df-4a39-b27a-3595f556088b', 'volume_size': 2, 'snapshot_id': '4ee7cddb-dce1-4ac9-b362-3c79a873cf43'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa26f9c-96df-401f-8c97-8535e0d0826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa26f9c-96df-401f-8c97-8535e0d0826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677614ae-4c96-47bd-b3b2-38e1dbd43523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Volume 551f5dba-85df-4a39-b27a-3595f556088b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-551f5dba-85df-4a39-b27a-3595f556088b', 'volume_size': 2, 'snapshot_id': '4ee7cddb-dce1-4ac9-b362-3c79a873cf43'} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:27 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 1G" returned: 0 in 0.600s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:27 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:27 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:27 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:27 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 is being set with open permissions: ugo+rw Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:27 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:27 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:27 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.659s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-551f5dba-85df-4a39-b27a-3595f556088b" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-551f5dba-85df-4a39-b27a-3595f556088b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Creating volume 551f5dba-85df-4a39-b27a-3595f556088b from snapshot 4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] snapshot: 4ee7cddb-dce1-4ac9-b362-3c79a873cf43, volume: 551f5dba-85df-4a39-b27a-3595f556088b, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:22:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a735b86b-03e0-4c0b-9938-84a6a1ac03c8 tempest-VolumesSnapshotListTestJSON-1158185595 None] Create snapshot completed successfully Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531f0f5-f344-42bb-9458-9bb133e58e7f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:28 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.425s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1b93a-0e7a-4bca-9027-89351b64cfca]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:28 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:28 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b Sep 25 16:22:28 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:35 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b" returned: 0 in 6.431s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:22:35 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Converted 1024.00 MB image at 159.18 MB/s Sep 25 16:22:35 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b is being set with open permissions: ugo+rw Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:35 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b Sep 25 16:22:35 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:35 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" released by "_copy_volume_from_snapshot" :: held 7.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=115,cinder:SELECT=111,cinder:DELETE=16,cinder:INSERT=25 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=98,cinder:UPDATE=117,cinder:INSERT=42,cinder:DELETE=7 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-551f5dba-85df-4a39-b27a-3595f556088b" released by "_create_volume_from_snapshot" :: held 7.755s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.777s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.149s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Creating offline snapshot 85ac8946-be5b-4faf-9e06-604dd90260df of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677614ae-4c96-47bd-b3b2-38e1dbd43523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551f5dba-85df-4a39-b27a-3595f556088b', 'volume_size': 2, 'snapshot_id': '4ee7cddb-dce1-4ac9-b362-3c79a873cf43'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b9e82-d96f-4c5d-900e-e91c7b5616dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e51b76-3df4-4665-8118-e8fbdc9fee80]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Volume volume-551f5dba-85df-4a39-b27a-3595f556088b (551f5dba-85df-4a39-b27a-3595f556088b): created successfully Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b9e82-d96f-4c5d-900e-e91c7b5616dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (ca1a921c-f5b9-4473-a9e5-b55e40cb9d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-260dd973-d12b-4c76-9ac1-f614c14feff7 tempest-VolumesSnapshotTestJSON-767908275 None] Created volume successfully. Sep 25 16:22:35 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:35 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:36 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:36 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df 1G Sep 25 16:22:36 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:36 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df 1G" returned: 0 in 0.461s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:36 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df Sep 25 16:22:36 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-551f5dba-85df-4a39-b27a-3595f556088b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:36 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df" returned: 0 in 0.359s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:36 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df is being set with open permissions: ugo+rw Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-551f5dba-85df-4a39-b27a-3595f556088b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:36 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df Sep 25 16:22:36 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb8ac1-5516-4855-9ff6-9c63b8672eee]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:37 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b Sep 25 16:22:37 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:37 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df" returned: 0 in 0.320s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.626s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1863f2f6-5c64-455a-9994-897fbc182d17 tempest-VolumesSnapshotListTestJSON-1158185595 None] Create snapshot completed successfully Sep 25 16:22:37 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:37 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b Sep 25 16:22:37 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:37 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-551f5dba-85df-4a39-b27a-3595f556088b" returned: 0 in 0.279s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-551f5dba-85df-4a39-b27a-3595f556088b" released by "delete_volume" :: held 0.764s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['af75b7b9-854e-4b8d-9d0b-d7046159b130', '98d0249d-991f-4e8c-8fe9-5ef5941110b1', '37840e1f-52dc-49b4-8fcc-4187c6abfbb0', 'bdc71be3-3f67-47e2-9a8b-e458046cdcaf'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:37 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:37 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Deleting offline snapshot 4ee7cddb-dce1-4ac9-b362-3c79a873cf43 of volume 953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] snapshot_file for this snap is: volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[91362cfd-cbe8-4a0b-ae72-24e1d74ca67d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:38 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Deleted volume successfully. Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5caf7ec9-d89d-4d7b-8295-e4fc80845d7c tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-551f5dba-85df-4a39-b27a-3595f556088b-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:38 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:38 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:38 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.444s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2ae3dd-5411-413d-a75d-134be707b415]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:38 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:38 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-85ac8946-be5b-4faf-9e06-604dd90260df-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-85ac8946-be5b-4faf-9e06-604dd90260df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-85ac8946-be5b-4faf-9e06-604dd90260df" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-85ac8946-be5b-4faf-9e06-604dd90260df" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Deleting offline snapshot 85ac8946-be5b-4faf-9e06-604dd90260df of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] snapshot_file for this snap is: volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc840d-58a3-45a5-a767-eff3fb32c013]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:39 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.567s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:39 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:39 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:39 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df Sep 25 16:22:39 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:39 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df" returned: 0 in 0.374s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:39 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[496bd28e-842b-4537-8613-14faf81a60bb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:39 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43 Sep 25 16:22:39 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:39 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:39 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:39 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d.4ee7cddb-dce1-4ac9-b362-3c79a873cf43" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-4ee7cddb-dce1-4ac9-b362-3c79a873cf43" released by "_delete_snapshot" :: held 1.763s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" released by "delete_snapshot" :: held 1.789s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['bbe226dc-60d3-45c4-b634-64609aceec3f', 'f780d204-b8c7-4014-8e53-20159e56d261', '233808d0-8ab4-433f-9099-bc62c30256c4', '0fd6fbcc-3d9f-49a8-99fc-8394bf4bd9c0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:40 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.403s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:40 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df Sep 25 16:22:40 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Delete snapshot completed successfully. Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a37c39e2-10aa-422e-a936-b2e6c89a56e0 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-4ee7cddb-dce1-4ac9-b362-3c79a873cf43-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-953cea4d-ba3c-4e3d-896f-c7362b5f267d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-953cea4d-ba3c-4e3d-896f-c7362b5f267d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2df201-42a7-4913-9d3c-0bc1c647be97]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:40 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df" returned: 0 in 0.527s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:40 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df Sep 25 16:22:40 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:40 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:40 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:40 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.85ac8946-be5b-4faf-9e06-604dd90260df" returned: 0 in 0.242s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-85ac8946-be5b-4faf-9e06-604dd90260df" released by "_delete_snapshot" :: held 1.666s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" released by "delete_snapshot" :: held 1.703s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:40 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:40 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d Sep 25 16:22:40 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:40 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Created reservations ['7baccc7b-f8c4-4a8c-9166-872de3ef3549', '310c4806-e1bc-4d14-a3c1-ff7e5a209ea6', '82ed5947-aef2-4c8d-a8e4-63c986936d36', 'f9ce656a-a53a-4a15-8a3b-4f417f323c44'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Delete snapshot completed successfully. Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a166d8a-6c81-40d5-92bf-318f3dd3c62f tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-85ac8946-be5b-4faf-9e06-604dd90260df-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:41 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-953cea4d-ba3c-4e3d-896f-c7362b5f267d" returned: 0 in 0.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-953cea4d-ba3c-4e3d-896f-c7362b5f267d" released by "delete_volume" :: held 0.728s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['41beeea2-ad8c-4972-b451-0480e9fb28e4', '03b5ddc4-5fff-4fa5-bff0-0a24d7b5519f', '5cd99737-fa07-40be-bbad-1ad130749af9', '1aa9822d-bd28-4e48-98a3-d450904a0469'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-cb571a50-c3a3-4d9f-9820-78d8eb793d41-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-cb571a50-c3a3-4d9f-9820-78d8eb793d41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-cb571a50-c3a3-4d9f-9820-78d8eb793d41" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-cb571a50-c3a3-4d9f-9820-78d8eb793d41" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Deleting offline snapshot cb571a50-c3a3-4d9f-9820-78d8eb793d41 of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] snapshot_file for this snap is: volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd508776-92f5-4a3d-bbac-216e9421fbc2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:41 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:41 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:41 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:41 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:41 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.277s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Deleted volume successfully. Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c328142f-43a6-4e25-9fc6-05dacf6d005e tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-953cea4d-ba3c-4e3d-896f-c7362b5f267d-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:41 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad79bd6-e58f-444b-a860-da0707fa124d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:42 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (3ed7e52b-0cbe-4969-9619-de5bbacce9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c733447-d19f-451d-90eb-9aa9b689460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c733447-d19f-451d-90eb-9aa9b689460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083697260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b216fc-a622-4267-9f44-16065ed2db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:42Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f875bfc-267e-4ba2-93f0-13b537db7a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f875bfc-267e-4ba2-93f0-13b537db7a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f2d26-3c12-4e8a-8218-448091edd02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f2d26-3c12-4e8a-8218-448091edd02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b216fc-a622-4267-9f44-16065ed2db51', 'volume_name': 'volume-e1b216fc-a622-4267-9f44-16065ed2db51', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbdf6f6-5c61-4cc5-b831-4ce439f6b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbdf6f6-5c61-4cc5-b831-4ce439f6b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b8fb05-8b52-44ad-8495-637f45d64220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Volume e1b216fc-a622-4267-9f44-16065ed2db51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b216fc-a622-4267-9f44-16065ed2db51', 'volume_size': 1} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083697260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b216fc-a622-4267-9f44-16065ed2db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:42Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Creating volume e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.447s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 1073741824 Sep 25 16:22:42 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:42 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:42 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:42 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41 Sep 25 16:22:42 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:42 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 1073741824" returned: 0 in 0.465s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:22:42 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:43 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.cb571a50-c3a3-4d9f-9820-78d8eb793d41" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-cb571a50-c3a3-4d9f-9820-78d8eb793d41" released by "_delete_snapshot" :: held 1.690s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" released by "delete_snapshot" :: held 1.729s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:43 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.295s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b8fb05-8b52-44ad-8495-637f45d64220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b216fc-a622-4267-9f44-16065ed2db51', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8fc965-f26c-4d88-b74b-15c7dd84cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Created reservations ['9b83a2f1-0ecc-472e-9897-681063045e9c', '8b56c044-fe0c-4244-b8a3-fc995333ec40', '4168da65-1016-41c1-bb73-eaf1649c72af', 'fbbf834e-e38c-4ec8-a11c-8032c80df2a0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Volume volume-e1b216fc-a622-4267-9f44-16065ed2db51 (e1b216fc-a622-4267-9f44-16065ed2db51): created successfully Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8fc965-f26c-4d88-b74b-15c7dd84cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (3ed7e52b-0cbe-4969-9619-de5bbacce9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6cfa430b-4bbb-4189-beff-4a64b36429c3 tempest-VolumesSnapshotTestJSON-767908275 None] Created volume successfully. Sep 25 16:22:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Delete snapshot completed successfully. Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49cb4456-3e27-4690-a1ab-b566f23551da tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-cb571a50-c3a3-4d9f-9820-78d8eb793d41-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-f4497f87-7947-4d4f-a2bc-daa825d4e374-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-f4497f87-7947-4d4f-a2bc-daa825d4e374-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-f4497f87-7947-4d4f-a2bc-daa825d4e374" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-f4497f87-7947-4d4f-a2bc-daa825d4e374" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Deleting offline snapshot f4497f87-7947-4d4f-a2bc-daa825d4e374 of volume 71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] snapshot_file for this snap is: volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd76b664-d2f3-44ca-80b5-5006606e7e76]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:43 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:43 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:43 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71396929-92ad-4b20-9bf9-ba08c27b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5bdde-96db-4221-bd06-c99393a45e0b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 Sep 25 16:22:44 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:44 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970" returned: 0 in 0.429s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:44 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Creating offline snapshot 8fdb0c3b-3917-45cc-8cad-a7b1c659954e of volume e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aad6cd-fc54-48af-88a5-47223760776f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:22:44 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:44 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.378s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374 Sep 25 16:22:44 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:44 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.404s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e 1G Sep 25 16:22:44 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:45 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970.f4497f87-7947-4d4f-a2bc-daa825d4e374" returned: 0 in 0.298s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-f4497f87-7947-4d4f-a2bc-daa825d4e374" released by "_delete_snapshot" :: held 1.634s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" released by "delete_snapshot" :: held 1.662s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Created reservations ['9d209a63-0b4b-4534-947d-bb847dfc5e69', 'cb06bdb5-71aa-4ebe-8a10-12d8ce339612', 'e30c39f2-dbc1-4673-83f5-08bd0ed56e01', '9fc681ec-a4ee-4520-8046-682199fc7ed1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Delete snapshot completed successfully. Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15c94aed-4ae3-488e-8783-354dde3634a3 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-f4497f87-7947-4d4f-a2bc-daa825d4e374-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:45 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e 1G" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b216fc-a622-4267-9f44-16065ed2db51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:45 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b216fc-a622-4267-9f44-16065ed2db51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:22:45 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:45 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b216fc-a622-4267-9f44-16065ed2db51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e is being set with open permissions: ugo+rw Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-71396929-92ad-4b20-9bf9-ba08c27b7970-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:45 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:22:45 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-71396929-92ad-4b20-9bf9-ba08c27b7970-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2963c4-591e-4053-b99b-0636552a4a26]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 Sep 25 16:22:46 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:46 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.325s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info Sep 25 16:22:46 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:46 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info" returned: 0 in 0.263s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info is being set with open permissions: ugo+rw Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970" returned: 0 in 0.472s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info Sep 25 16:22:46 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:46 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970 Sep 25 16:22:46 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:46 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.info" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:46 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-71396929-92ad-4b20-9bf9-ba08c27b7970" returned: 0 in 0.286s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-quobyte-71396929-92ad-4b20-9bf9-ba08c27b7970" released by "delete_volume" :: held 0.842s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ff7fad64-5b80-4e2b-b392-73d8eb5feb49 tempest-VolumesSnapshotTestJSON-767908275 None] Create snapshot completed successfully Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Created reservations ['d28b8a86-2b2f-4970-9e41-2799192d796b', '4892eebb-3eb6-4445-b8d6-e777e99b1fad', '145393da-16bd-40c8-a11e-e56173981f01', 'db027283-cba4-41b9-8882-c07316507615'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:46 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:47 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.295s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Deleted volume successfully. Sep 25 16:22:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fe583f83-e534-42d8-9f1c-10cd74ea0b73 tempest-VolumesSnapshotListTestJSON-1158185595 None] Lock "cinder-71396929-92ad-4b20-9bf9-ba08c27b7970-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (8e8d0333-bd0c-45e0-9904-8bd7e68bea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c463c0a-69e1-416e-ac2b-7939e127da72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c463c0a-69e1-416e-ac2b-7939e127da72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-757306297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3ad6f7-e521-42c4-b9a8-9626377555af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d4824c28c74b5286942f4288e20467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fdb0c3b-3917-45cc-8cad-a7b1c659954e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:48Z,use_quota=True,user_id='2dfed7fd4c924c538b1e619ba59c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92345632-c0ce-4ad4-a2c5-37621e058169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92345632-c0ce-4ad4-a2c5-37621e058169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3051f6b3-f6b1-4efc-91b0-931d8d2fcfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3051f6b3-f6b1-4efc-91b0-931d8d2fcfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c3ad6f7-e521-42c4-b9a8-9626377555af', 'volume_name': 'volume-7c3ad6f7-e521-42c4-b9a8-9626377555af', 'volume_size': 1, 'snapshot_id': '8fdb0c3b-3917-45cc-8cad-a7b1c659954e'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc0c229-e32d-4b5b-ba73-f15b5d021ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc0c229-e32d-4b5b-ba73-f15b5d021ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd866bf2-5dee-4f85-a8eb-33b2074b2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Volume 7c3ad6f7-e521-42c4-b9a8-9626377555af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c3ad6f7-e521-42c4-b9a8-9626377555af', 'volume_size': 1, 'snapshot_id': '8fdb0c3b-3917-45cc-8cad-a7b1c659954e'} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-7c3ad6f7-e521-42c4-b9a8-9626377555af" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-7c3ad6f7-e521-42c4-b9a8-9626377555af" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Creating volume 7c3ad6f7-e521-42c4-b9a8-9626377555af from snapshot 8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] snapshot: 8fdb0c3b-3917-45cc-8cad-a7b1c659954e, volume: 7c3ad6f7-e521-42c4-b9a8-9626377555af, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d090d-0362-4769-b6cb-4f9b0b9c5444]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:48 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:22:48 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:48 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.459s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1b216fc-a622-4267-9f44-16065ed2db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[39079619-f48a-439a-85fa-0a58fb0cc836]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:49 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:22:49 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:49 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:22:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:22:49 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:22:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:49 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af Sep 25 16:22:49 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:55 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af" returned: 0 in 6.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:55 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:22:55 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Converted 1024.00 MB image at 155.71 MB/s Sep 25 16:22:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af is being set with open permissions: ugo+rw Sep 25 16:22:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:56 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af Sep 25 16:22:56 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:56 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af" returned: 0 in 0.260s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" released by "_copy_volume_from_snapshot" :: held 7.844s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-7c3ad6f7-e521-42c4-b9a8-9626377555af" released by "_create_volume_from_snapshot" :: held 7.921s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.943s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd866bf2-5dee-4f85-a8eb-33b2074b2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3ad6f7-e521-42c4-b9a8-9626377555af', 'volume_size': 1, 'snapshot_id': '8fdb0c3b-3917-45cc-8cad-a7b1c659954e'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b945b1e-83ee-4c49-b5fd-47275511f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Volume volume-7c3ad6f7-e521-42c4-b9a8-9626377555af (7c3ad6f7-e521-42c4-b9a8-9626377555af): created successfully Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b945b1e-83ee-4c49-b5fd-47275511f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Flow 'volume_create_manager' (8e8d0333-bd0c-45e0-9904-8bd7e68bea74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cb71c9e4-31c3-4b39-8868-ad029170bd0a tempest-VolumesSnapshotTestJSON-767908275 None] Created volume successfully. Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Flow 'volume_create_manager' (ee25e89a-3a68-4c5f-b60d-a79a1a88c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b69d206-4eb7-4126-998d-349b23fe3f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b69d206-4eb7-4126-998d-349b23fe3f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf68294b-7bd6-4405-a54d-f035584d4e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0058bbc932444499aa00f279b9eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:57Z,use_quota=True,user_id='2e2ed996c3fa40b9a39bd912e1e04365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7cecb01-9ba1-40a1-95b7-d81956481c46),volume_type_id=b7cecb01-9ba1-40a1-95b7-d81956481c46)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6b3082-6829-431b-93cf-c296bcecc9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6b3082-6829-431b-93cf-c296bcecc9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a40bce6-9817-404e-bb0e-e5250d54c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-7c3ad6f7-e521-42c4-b9a8-9626377555af-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-7c3ad6f7-e521-42c4-b9a8-9626377555af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05ff4b-6f6b-4573-ad1e-11582691a835]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:57 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af Sep 25 16:22:57 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a40bce6-9817-404e-bb0e-e5250d54c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf68294b-7bd6-4405-a54d-f035584d4e40', 'volume_name': 'volume-cf68294b-7bd6-4405-a54d-f035584d4e40', 'volume_size': 1, 'image_id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '834ebd80d01a0e8693548dac5f7ed1ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f0058bbc932444499aa00f279b9eefd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '68d032f96912d585875aca24beff45cc106f3f338462be9774f799cd3d92053d1e97cd94e132901564897621017a6ad7ef0a48be2559a7df1914f1c567614f79', 'id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'created_at': datetime.datetime(2026, 9, 25, 14, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35642d6-9bf7-4166-9993-faa5230dfb71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4722050-d9f4-4dbc-8acd-92182c7835ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4722050-d9f4-4dbc-8acd-92182c7835ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc691848-c801-468f-8f62-be9b5f4ed618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Volume cf68294b-7bd6-4405-a54d-f035584d4e40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf68294b-7bd6-4405-a54d-f035584d4e40', 'volume_size': 1, 'image_id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '834ebd80d01a0e8693548dac5f7ed1ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f0058bbc932444499aa00f279b9eefd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '68d032f96912d585875aca24beff45cc106f3f338462be9774f799cd3d92053d1e97cd94e132901564897621017a6ad7ef0a48be2559a7df1914f1c567614f79', 'id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'created_at': datetime.datetime(2026, 9, 25, 14, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35642d6-9bf7-4166-9993-faa5230dfb71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Trying to clone cf68294b-7bd6-4405-a54d-f035584d4e40 from image a35642d6-9bf7-4166-9993-faa5230dfb71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:22:57 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bce0dea-acaf-4faf-8d45-5f96ada8d645]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:57 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:57 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:22:57 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:57 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af Sep 25 16:22:57 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:57 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:57 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7c3ad6f7-e521-42c4-b9a8-9626377555af" returned: 0 in 0.265s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-7c3ad6f7-e521-42c4-b9a8-9626377555af" released by "delete_volume" :: held 0.725s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['b4e0414a-ac01-4135-bbe2-9543fef6186c', 'c7b19a49-6756-4e2c-ad43-da7e9deac74f', 'e16e3011-f3bf-4974-b48c-c073f0ae453b', '4c068642-ff4f-4713-bd66-bf657d517268'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:58 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:22:58 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:22:58 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Temporary image a35642d6-9bf7-4166-9993-faa5230dfb71 is fetched for user 2e2ed996c3fa40b9a39bd912e1e04365. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed229e-3e0a-4383-a3d1-0679393b17e1]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Deleted volume successfully. Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b052e1f9-a92f-4d15-abe7-0048d5269dab tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-7c3ad6f7-e521-42c4-b9a8-9626377555af-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Deleting offline snapshot 8fdb0c3b-3917-45cc-8cad-a7b1c659954e of volume e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] snapshot_file for this snap is: volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:22:58 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:22:58 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[42340395-43f7-411d-9d3f-99f0143f2730]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:22:58 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:22:58 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1b216fc-a622-4267-9f44-16065ed2db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c5856-87af-4610-833c-19ded4ab748f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:22:59 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf68294b-7bd6-4405-a54d-f035584d4e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0058bbc932444499aa00f279b9eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:57Z,use_quota=True,user_id='2e2ed996c3fa40b9a39bd912e1e04365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7cecb01-9ba1-40a1-95b7-d81956481c46),volume_type_id=b7cecb01-9ba1-40a1-95b7-d81956481c46)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Creating volume cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:59 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1073741824 Sep 25 16:22:59 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.625s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1073741824" returned: 0 in 0.462s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:22:59 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 Sep 25 16:22:59 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40" returned: 0 in 0.279s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Attempting download of a35642d6-9bf7-4166-9993-faa5230dfb71 ((None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}])) to volume cf68294b-7bd6-4405-a54d-f035584d4e40. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e93476-f0a6-470f-a79b-5e07be3c7baf]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.436s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e Sep 25 16:23:00 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:00 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v Sep 25 16:23:00 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:00 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51.8fdb0c3b-3917-45cc-8cad-a7b1c659954e" returned: 0 in 0.318s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-8fdb0c3b-3917-45cc-8cad-a7b1c659954e" released by "_delete_snapshot" :: held 1.924s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:00 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v" returned: 0 in 0.388s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" released by "delete_snapshot" :: held 1.957s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['fdafdd82-3d1a-4c18-a4db-39ebacf72d97', 'd53e8cfb-4e66-4704-ad53-d2f603dc7fc2', '4b41cc47-e09d-4a24-a2b3-5661ed31c348', '2180ef59-fbd6-458f-8ba3-32559b816f1e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:00 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v Sep 25 16:23:00 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Delete snapshot completed successfully. Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9e0fe4e-a0b0-46f6-a6c9-c0d0fc40019a tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-8fdb0c3b-3917-45cc-8cad-a7b1c659954e-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-e1b216fc-a622-4267-9f44-16065ed2db51-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-e1b216fc-a622-4267-9f44-16065ed2db51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1421008e-0f1d-4259-be23-d61cfb988b9d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v" returned: 1 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35642d6-9bf7-4166-9993-faa5230dfb71_mnjpjj1v' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1d967-8691-4a7f-b26c-1732d598b6bd]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:23:00 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:00 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:23:00 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51 Sep 25 16:23:01 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD Sep 25 16:23:01 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e1b216fc-a622-4267-9f44-16065ed2db51" returned: 0 in 0.275s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-e1b216fc-a622-4267-9f44-16065ed2db51" released by "delete_volume" :: held 0.726s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:01 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] a35642d6-9bf7-4166-9993-faa5230dfb71 was raw, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 Sep 25 16:23:01 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['330f7811-a722-4c1f-ab13-0e0454ce78e2', '2316b03d-2984-41c3-a632-c746bd8afc94', 'd712b034-5765-4cd6-b7b7-237ba341546f', 'cac7e998-1b82-478c-a577-a1db37d167b0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:01 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Deleted volume successfully. Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-858c0124-540b-49d6-8c83-5658d1e72c8f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-05e23b05-01ea-4aac-afc0-47294f4125c2 tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-e1b216fc-a622-4267-9f44-16065ed2db51-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-858c0124-540b-49d6-8c83-5658d1e72c8f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:02 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40" returned: 0 in 0.584s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a35642d6-9bf7-4166-9993-faa5230dfb71_kb47ovtkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:23:02 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f3ace3-ac82-4e2d-b13b-6f8941368b04]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1G Sep 25 16:23:02 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f Sep 25 16:23:02 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 1G" returned: 0 in 0.329s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Downloaded image a35642d6-9bf7-4166-9993-faa5230dfb71 ((None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}])) to volume cf68294b-7bd6-4405-a54d-f035584d4e40 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Temporary image a35642d6-9bf7-4166-9993-faa5230dfb71 for user 2e2ed996c3fa40b9a39bd912e1e04365 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Marking volume cf68294b-7bd6-4405-a54d-f035584d4e40 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Copying metadata from image a35642d6-9bf7-4166-9993-faa5230dfb71 to cf68294b-7bd6-4405-a54d-f035584d4e40. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Creating volume glance metadata for volume cf68294b-7bd6-4405-a54d-f035584d4e40 backed by image a35642d6-9bf7-4166-9993-faa5230dfb71 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '834ebd80d01a0e8693548dac5f7ed1ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc691848-c801-468f-8f62-be9b5f4ed618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf68294b-7bd6-4405-a54d-f035584d4e40', 'volume_size': 1, 'image_id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35642d6-9bf7-4166-9993-faa5230dfb71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '834ebd80d01a0e8693548dac5f7ed1ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f0058bbc932444499aa00f279b9eefd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '68d032f96912d585875aca24beff45cc106f3f338462be9774f799cd3d92053d1e97cd94e132901564897621017a6ad7ef0a48be2559a7df1914f1c567614f79', 'id': 'a35642d6-9bf7-4166-9993-faa5230dfb71', 'created_at': datetime.datetime(2026, 9, 25, 14, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35642d6-9bf7-4166-9993-faa5230dfb71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:02 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8213288f-129e-47e9-b77c-49631c9d5430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f" returned: 0 in 0.420s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Volume volume-cf68294b-7bd6-4405-a54d-f035584d4e40 (cf68294b-7bd6-4405-a54d-f035584d4e40): created successfully Sep 25 16:23:02 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f Sep 25 16:23:02 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8213288f-129e-47e9-b77c-49631c9d5430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Flow 'volume_create_manager' (ee25e89a-3a68-4c5f-b60d-a79a1a88c77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30851d31-b641-4ff0-9ebf-640083f85ab9 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Created volume successfully. Sep 25 16:23:02 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-858c0124-540b-49d6-8c83-5658d1e72c8f" returned: 0 in 0.257s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-quobyte-858c0124-540b-49d6-8c83-5658d1e72c8f" released by "delete_volume" :: held 0.753s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Created reservations ['d853f64c-dd0d-47f7-b064-561bfe194766', '51f001a8-35d5-4495-9a1c-a04066ff0246', 'c8d3b7de-e0a5-4df8-b3ce-5871ce5f68dd', 'bcd55d22-7112-45f9-966a-681b8858e6db'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:02 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:03 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.242s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Deleted volume successfully. Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-843031c6-38c7-4ca3-b0c0-9e539033857f tempest-VolumesSnapshotTestJSON-767908275 None] Lock "cinder-858c0124-540b-49d6-8c83-5658d1e72c8f-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Acquiring lock "cinder-cf68294b-7bd6-4405-a54d-f035584d4e40-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "cinder-cf68294b-7bd6-4405-a54d-f035584d4e40-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Acquiring lock "cinder-quobyte-cf68294b-7bd6-4405-a54d-f035584d4e40" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "cinder-quobyte-cf68294b-7bd6-4405-a54d-f035584d4e40" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d82b6-db9a-40c6-965f-5a172b3aa5d8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:03 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 Sep 25 16:23:03 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:04 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40" returned: 0 in 0.479s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:04 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40 Sep 25 16:23:04 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:04 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf68294b-7bd6-4405-a54d-f035584d4e40" returned: 0 in 0.275s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "cinder-quobyte-cf68294b-7bd6-4405-a54d-f035584d4e40" released by "delete_volume" :: held 0.806s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:04 devstack cinder-volume[87199]: WARNING cinder.quota [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:23:04 devstack cinder-volume[87199]: WARNING cinder.quota [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Created reservations ['2d2218fc-adc3-496f-bbc5-63ba8b3f8c99', 'b587d521-bfb4-40ca-9e7c-ef43fb2b81d4', 'a6aad7e3-8c1f-45ba-b9f2-af735306fcf7', '88b7f344-48c4-4845-8f26-6cea0077c6e8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:04 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:04 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:04 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.311s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Deleted volume successfully. Sep 25 16:23:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9cfe4271-31af-4e9a-a780-9f150a75c894 tempest-VolumeAndVolumeTypeFromImageTest-1380038592 None] Lock "cinder-cf68294b-7bd6-4405-a54d-f035584d4e40-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:06 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:06 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:06 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (21c33a78-8c99-48a1-9ec4-379860a64c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fba711-1805-4b38-b519-f59162531082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fba711-1805-4b38-b519-f59162531082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133024067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e997ac2-6bf6-49f5-a46e-384305799a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:10Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd472de-ee43-4f77-9a57-6aa4099b4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd472de-ee43-4f77-9a57-6aa4099b4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec884400-e8b3-4755-b876-fd0481b49533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec884400-e8b3-4755-b876-fd0481b49533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e997ac2-6bf6-49f5-a46e-384305799a47', 'volume_name': 'volume-2e997ac2-6bf6-49f5-a46e-384305799a47', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e903598-a08f-42b7-bebc-5a1562967e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e903598-a08f-42b7-bebc-5a1562967e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaebd62-960b-4eac-b57d-45a5ff231ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume 2e997ac2-6bf6-49f5-a46e-384305799a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e997ac2-6bf6-49f5-a46e-384305799a47', 'volume_size': 1} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133024067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e997ac2-6bf6-49f5-a46e-384305799a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:10Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume 2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:09 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 1073741824 Sep 25 16:23:09 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:10 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 1073741824" returned: 0 in 0.469s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:10 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 Sep 25 16:23:10 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:10 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47" returned: 0 in 0.304s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaebd62-960b-4eac-b57d-45a5ff231ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e997ac2-6bf6-49f5-a46e-384305799a47', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e7f504-190a-4ee6-ac6f-10160bbac5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-2e997ac2-6bf6-49f5-a46e-384305799a47 (2e997ac2-6bf6-49f5-a46e-384305799a47): created successfully Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e7f504-190a-4ee6-ac6f-10160bbac5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (21c33a78-8c99-48a1-9ec4-379860a64c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bebe957a-2c18-49fa-86c4-df46c785f11d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating offline snapshot 4f015f64-9ccb-4890-bce7-7fa2387eaa90 of volume 2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3abd7a-8f9e-43f5-9227-9bc0ef0ea3a1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:12 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 Sep 25 16:23:12 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:12 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47" returned: 0 in 0.412s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:12 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 1G Sep 25 16:23:12 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:13 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 1G" returned: 0 in 0.489s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e997ac2-6bf6-49f5-a46e-384305799a47 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:13 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e997ac2-6bf6-49f5-a46e-384305799a47 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 Sep 25 16:23:13 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:13 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e997ac2-6bf6-49f5-a46e-384305799a47 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90" returned: 0 in 0.349s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:13 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 is being set with open permissions: ugo+rw Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:13 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 Sep 25 16:23:13 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:13 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90" returned: 0 in 0.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:13 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info Sep 25 16:23:13 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:14 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info" returned: 0 in 0.288s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info is being set with open permissions: ugo+rw Sep 25 16:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:14 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info Sep 25 16:23:14 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:14 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.info" returned: 0 in 0.324s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f2568116-6a60-4bb2-96f9-b03c5601c6b5 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Create snapshot completed successfully Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (2100f070-d799-4513-a280-4b680c861b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff448dac-0007-41d3-9a09-e2e84dd75b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff448dac-0007-41d3-9a09-e2e84dd75b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760376874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4543a8d-a278-4965-b3e9-23c5d71edcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:16Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbcaaba-7c9c-458f-a096-c05c3789f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbcaaba-7c9c-458f-a096-c05c3789f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a84165-ec3e-461a-8d23-eb62d4cdd4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a84165-ec3e-461a-8d23-eb62d4cdd4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4543a8d-a278-4965-b3e9-23c5d71edcc1', 'volume_name': 'volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffdcac2-0abf-4899-95c5-7f06a3767f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffdcac2-0abf-4899-95c5-7f06a3767f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4fe64d-aa04-4dc0-b19f-97e7ccdf688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume e4543a8d-a278-4965-b3e9-23c5d71edcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1', 'volume_size': 1} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760376874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4543a8d-a278-4965-b3e9-23c5d71edcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:16Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume e4543a8d-a278-4965-b3e9-23c5d71edcc1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:16 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:16 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 1073741824 Sep 25 16:23:16 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (e1716f0b-4ecb-4915-887e-68c7f7fdfb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec24cee-7e7e-46c0-a354-ef3f10472b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec24cee-7e7e-46c0-a354-ef3f10472b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095362771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f81e3be-795a-4d3b-961c-870e198d51b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:16Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d355edb7-0073-4be3-8840-4eb595690138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d355edb7-0073-4be3-8840-4eb595690138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78909867-7afe-4c0c-bcde-0674270b0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78909867-7afe-4c0c-bcde-0674270b0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f81e3be-795a-4d3b-961c-870e198d51b8', 'volume_name': 'volume-4f81e3be-795a-4d3b-961c-870e198d51b8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afc5970-82c9-4d53-b234-709a1c8c4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afc5970-82c9-4d53-b234-709a1c8c4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce26a59-d28d-49e7-837e-9d0b31e08e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume 4f81e3be-795a-4d3b-961c-870e198d51b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f81e3be-795a-4d3b-961c-870e198d51b8', 'volume_size': 1} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:16 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 1073741824" returned: 0 in 0.621s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:16 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 Sep 25 16:23:16 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (f8dc368f-e783-4a93-b884-b5baae59b308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a951018-cbcd-4801-a651-b3c3becae296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a951018-cbcd-4801-a651-b3c3becae296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692783228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6edf04-1a29-44ce-8015-d3821c323253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:17Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded5888b-d05a-415e-81ea-802656478532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded5888b-d05a-415e-81ea-802656478532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5327bd5-dfad-4f01-a768-938a16dec32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5327bd5-dfad-4f01-a768-938a16dec32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6edf04-1a29-44ce-8015-d3821c323253', 'volume_name': 'volume-ef6edf04-1a29-44ce-8015-d3821c323253', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5100c174-c56d-46e5-92cf-c95002c09943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5100c174-c56d-46e5-92cf-c95002c09943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940e6eb-677d-4051-8f4a-5ea646ea6b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume ef6edf04-1a29-44ce-8015-d3821c323253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6edf04-1a29-44ce-8015-d3821c323253', 'volume_size': 1} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:17 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095362771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f81e3be-795a-4d3b-961c-870e198d51b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:16Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume 4f81e3be-795a-4d3b-961c-870e198d51b8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:17 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4fe64d-aa04-4dc0-b19f-97e7ccdf688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 1073741824 Sep 25 16:23:17 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991b2500-e368-404c-8c78-fd940894af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 (e4543a8d-a278-4965-b3e9-23c5d71edcc1): created successfully Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991b2500-e368-404c-8c78-fd940894af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (2100f070-d799-4513-a280-4b680c861b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4992def6-538e-4065-b4f4-210cb4b85826 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (1fa5f7a4-7914-4bb5-9c67-aaaaaf8a16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bf0ad8-92d4-4d05-a931-1a17e406902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bf0ad8-92d4-4d05-a931-1a17e406902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745618335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ed839-c3e6-4de3-abf1-06783c41b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ed839-c3e6-4de3-abf1-06783c41b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4a72bc-8c1a-478a-81cf-e653a2c413c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4a72bc-8c1a-478a-81cf-e653a2c413c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd', 'volume_name': 'volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f912a84-af12-420e-a1e2-5454bb740b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f912a84-af12-420e-a1e2-5454bb740b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4f2a5a-95d1-4bb4-84e1-8cb1a83be271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd', 'volume_size': 1} Sep 25 16:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:18 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 1073741824" returned: 0 in 0.704s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:18 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 Sep 25 16:23:18 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (26569cd0-e3c1-46a1-8e67-9b2b027c8014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7d4d7-554a-4f0e-a24b-c2e77610dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7d4d7-554a-4f0e-a24b-c2e77610dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744341418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf5daf8-31d0-4077-98b2-5381719d8eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ccb1a6-2948-49f7-83ae-3a2c74d42de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ccb1a6-2948-49f7-83ae-3a2c74d42de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bc94aa-145c-4116-80da-66669b4d3e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bc94aa-145c-4116-80da-66669b4d3e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf5daf8-31d0-4077-98b2-5381719d8eda', 'volume_name': 'volume-3bf5daf8-31d0-4077-98b2-5381719d8eda', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d38d7-b4c8-4a50-ad45-c569baec6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d38d7-b4c8-4a50-ad45-c569baec6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a3a72d-b98c-4b0f-a221-837f30d6bbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume 3bf5daf8-31d0-4077-98b2-5381719d8eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf5daf8-31d0-4077-98b2-5381719d8eda', 'volume_size': 1} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:18 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8" returned: 0 in 0.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692783228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6edf04-1a29-44ce-8015-d3821c323253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:17Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume ef6edf04-1a29-44ce-8015-d3821c323253 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce26a59-d28d-49e7-837e-9d0b31e08e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f81e3be-795a-4d3b-961c-870e198d51b8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ffeafc-803c-4677-9955-d3bc9d354a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 1073741824 Sep 25 16:23:18 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-4f81e3be-795a-4d3b-961c-870e198d51b8 (4f81e3be-795a-4d3b-961c-870e198d51b8): created successfully Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ffeafc-803c-4677-9955-d3bc9d354a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (e1716f0b-4ecb-4915-887e-68c7f7fdfb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7e95566f-56de-495b-88a5-e1d7bcc6425a tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:19 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 1073741824" returned: 0 in 0.567s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:19 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 Sep 25 16:23:19 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:19 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745618335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940e6eb-677d-4051-8f4a-5ea646ea6b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6edf04-1a29-44ce-8015-d3821c323253', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:19 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd 1073741824 Sep 25 16:23:19 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d6bdc0-669c-4567-83eb-ed84def37f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-ef6edf04-1a29-44ce-8015-d3821c323253 (ef6edf04-1a29-44ce-8015-d3821c323253): created successfully Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d6bdc0-669c-4567-83eb-ed84def37f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (f8dc368f-e783-4a93-b884-b5baae59b308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-eefdef5b-1799-4322-b948-309d95f57e3d tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:19 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd 1073741824" returned: 0 in 0.549s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:20 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd Sep 25 16:23:20 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:20 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" returned: 0 in 0.318s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744341418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf5daf8-31d0-4077-98b2-5381719d8eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8750a05eb7400abed624bfe54c6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='9f037d6e26af46838b907ace2fe54f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Creating volume 3bf5daf8-31d0-4077-98b2-5381719d8eda {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:20 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4f2a5a-95d1-4bb4-84e1-8cb1a83be271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b0bfe0-9a1d-462f-8d78-67ccecba7698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:20 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda 1073741824 Sep 25 16:23:20 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd (ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd): created successfully Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b0bfe0-9a1d-462f-8d78-67ccecba7698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (1fa5f7a4-7914-4bb5-9c67-aaaaaf8a16b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-521dccc2-00ce-4355-90d1-a4e798a56ce0 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:20 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda 1073741824" returned: 0 in 0.576s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:20 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda Sep 25 16:23:20 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:21 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda" returned: 0 in 0.276s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a3a72d-b98c-4b0f-a221-837f30d6bbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf5daf8-31d0-4077-98b2-5381719d8eda', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4d3db4-7609-45bd-881d-b6312e384544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Volume volume-3bf5daf8-31d0-4077-98b2-5381719d8eda (3bf5daf8-31d0-4077-98b2-5381719d8eda): created successfully Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4d3db4-7609-45bd-881d-b6312e384544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Flow 'volume_create_manager' (26569cd0-e3c1-46a1-8e67-9b2b027c8014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-69f49a1d-d7f8-4374-a455-485ee9353e5e tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created volume successfully. Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-3bf5daf8-31d0-4077-98b2-5381719d8eda-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-3bf5daf8-31d0-4077-98b2-5381719d8eda-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-3bf5daf8-31d0-4077-98b2-5381719d8eda" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-3bf5daf8-31d0-4077-98b2-5381719d8eda" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40c2273-f43e-4127-bc90-01b1f8bbb20a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:22 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda Sep 25 16:23:22 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:22 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:22 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda Sep 25 16:23:22 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:22 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3bf5daf8-31d0-4077-98b2-5381719d8eda" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-3bf5daf8-31d0-4077-98b2-5381719d8eda" released by "delete_volume" :: held 0.829s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['59888181-fba0-4534-99e4-2b2c599999e5', 'ecbd85f3-8184-4378-be76-6d00d25bc7f6', 'f846b73b-c332-488d-bd6f-e147c774fbc9', '49e17b4d-cf94-4144-be17-cedd7b9540c1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:23 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[59adea74-98a2-4da0-a01e-5da84ea26e6f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:23 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd Sep 25 16:23:23 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.342s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3fab3f12-34eb-41fb-b9e2-61a57e4cee33 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-3bf5daf8-31d0-4077-98b2-5381719d8eda-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:23 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" returned: 0 in 0.490s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd Sep 25 16:23:23 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:23 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" returned: 0 in 0.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd" released by "delete_volume" :: held 0.863s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['83b179b7-9cfa-4806-93bc-1f8c8fe33187', 'cdf055d5-697e-4a44-ac19-fec41a389d9d', '1eae19c3-51f3-4364-a449-5ef5f38fc2c7', '207e1aa2-c1fe-40fe-a8cb-838e710fb7b2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:24 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:24 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-ef6edf04-1a29-44ce-8015-d3821c323253-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-ef6edf04-1a29-44ce-8015-d3821c323253-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-ef6edf04-1a29-44ce-8015-d3821c323253" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-ef6edf04-1a29-44ce-8015-d3821c323253" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[122cb731-0e3c-4888-ac32-ac017fc61555]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:24 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.333s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:24 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 Sep 25 16:23:24 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ed3fb71-0926-481d-a6ae-4408d4a2207c tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-ab6e3bd5-97c9-4a4b-842c-5ed0d27774bd-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:24 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:24 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253 Sep 25 16:23:24 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:25 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ef6edf04-1a29-44ce-8015-d3821c323253" returned: 0 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-ef6edf04-1a29-44ce-8015-d3821c323253" released by "delete_volume" :: held 0.894s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['9d7f9219-2cbb-4df3-9c61-7a84a9dd814d', 'fda1f6c6-68af-4b99-b35e-8d1cf4e4d60a', '42a18764-82a0-4711-a852-fc85636cea16', 'cea3b001-618f-4b45-99da-233d77e4d787'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:25 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:25 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-4f81e3be-795a-4d3b-961c-870e198d51b8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-4f81e3be-795a-4d3b-961c-870e198d51b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-4f81e3be-795a-4d3b-961c-870e198d51b8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-4f81e3be-795a-4d3b-961c-870e198d51b8" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb55e471-791c-4b15-ba53-c8eb82fdbd7d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:25 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 Sep 25 16:23:25 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:25 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e3dbd0d3-a4a1-4118-8e55-de5ae8856507 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-ef6edf04-1a29-44ce-8015-d3821c323253-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:26 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8" returned: 0 in 0.550s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:26 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8 Sep 25 16:23:26 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:26 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4f81e3be-795a-4d3b-961c-870e198d51b8" returned: 0 in 0.270s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-4f81e3be-795a-4d3b-961c-870e198d51b8" released by "delete_volume" :: held 0.881s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['95939350-b657-41e3-86e7-3a97cae4afd9', 'a9e3e2ec-5276-4338-8cf5-da4ed1ca0f83', '3b79abde-9019-400c-a235-52faf5e09146', 'a9503496-54f0-4390-b825-8480cadac5a9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:26 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:26 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-e4543a8d-a278-4965-b3e9-23c5d71edcc1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-e4543a8d-a278-4965-b3e9-23c5d71edcc1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-e4543a8d-a278-4965-b3e9-23c5d71edcc1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-e4543a8d-a278-4965-b3e9-23c5d71edcc1" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baf7238-f8d3-4f95-ba75-074e90dd794a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:27 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.353s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:27 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 Sep 25 16:23:27 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f217decb-75dc-4aef-8358-2651e8457195 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-4f81e3be-795a-4d3b-961c-870e198d51b8-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:27 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1" returned: 0 in 0.502s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:27 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1 Sep 25 16:23:27 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:27 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-e4543a8d-a278-4965-b3e9-23c5d71edcc1" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-e4543a8d-a278-4965-b3e9-23c5d71edcc1" released by "delete_volume" :: held 0.835s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['71e9737b-39fc-42f5-9663-13eadf6fa419', '76336799-031e-40b6-95a6-6fff31286471', 'f8b2e7da-b9e0-4a09-85da-df57aadce114', 'f1da00e8-4755-412d-95ff-4595c2fad927'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:27 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:27 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-4f015f64-9ccb-4890-bce7-7fa2387eaa90-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-4f015f64-9ccb-4890-bce7-7fa2387eaa90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-4f015f64-9ccb-4890-bce7-7fa2387eaa90" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-4f015f64-9ccb-4890-bce7-7fa2387eaa90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleting offline snapshot 4f015f64-9ccb-4890-bce7-7fa2387eaa90 of volume 2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] snapshot_file for this snap is: volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea93648-75a1-477f-a0fc-c32fd19f40d2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:28 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.372s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bc6af691-44e5-4c10-a623-44557cced5f2 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-e4543a8d-a278-4965-b3e9-23c5d71edcc1-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:28 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 Sep 25 16:23:28 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:28 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90" returned: 0 in 0.463s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e997ac2-6bf6-49f5-a46e-384305799a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728d3dd-5c56-4ac4-bc0c-21f2b745e14a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:28 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 Sep 25 16:23:28 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:29 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47" returned: 0 in 0.475s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:29 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 Sep 25 16:23:29 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:29 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90" returned: 0 in 0.370s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:29 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90 Sep 25 16:23:29 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:29 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47.4f015f64-9ccb-4890-bce7-7fa2387eaa90" returned: 0 in 0.268s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-4f015f64-9ccb-4890-bce7-7fa2387eaa90" released by "_delete_snapshot" :: held 1.730s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" released by "delete_snapshot" :: held 1.755s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['a8888332-cfe6-4584-8471-f186a61d0333', 'ae2b81c6-ed02-49aa-8d27-c8f183cf9b99', 'cdee38bd-d831-49bb-8a4d-81bc956bfcea', '1e2c02b1-91e0-4a4a-8168-337853138c00'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Delete snapshot completed successfully. Sep 25 16:23:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-037df107-ee80-49f3-a8c8-87be0f939443 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-4f015f64-9ccb-4890-bce7-7fa2387eaa90-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-2e997ac2-6bf6-49f5-a46e-384305799a47-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-2e997ac2-6bf6-49f5-a46e-384305799a47-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f8017b-3e48-462b-b508-defb0691f63d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:30 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 Sep 25 16:23:30 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:30 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47" returned: 0 in 0.396s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:30 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47 Sep 25 16:23:30 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:31 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2e997ac2-6bf6-49f5-a46e-384305799a47" returned: 0 in 0.270s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-quobyte-2e997ac2-6bf6-49f5-a46e-384305799a47" released by "delete_volume" :: held 0.769s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Created reservations ['f7b7e2fb-fd55-49b3-aed7-4552977ae51c', '37635555-91ff-47b5-a553-8d860c5de9a7', 'd5fdb916-98a5-43cd-b7b4-4ca9948fdb7d', '0df15d22-293c-4189-96d5-fce8f1b31071'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:31 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:31 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:31 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.298s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Deleted volume successfully. Sep 25 16:23:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a7c73e-91dc-4b9c-a841-4e25ca486771 tempest-CreateVolumesFromSnapshotTest-1131901419 None] Lock "cinder-2e997ac2-6bf6-49f5-a46e-384305799a47-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (8962faf9-e3a2-4f31-8468-ccf02e3242b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5839ef4b-bcd6-49fe-970d-05f261e62d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5839ef4b-bcd6-49fe-970d-05f261e62d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708806184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e6631d-7b3d-48a9-93c9-e0122713536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c62388-fd1d-41b5-b396-3e804514179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c62388-fd1d-41b5-b396-3e804514179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb513b0-e754-496d-be00-725b50d70a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb513b0-e754-496d-be00-725b50d70a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e6631d-7b3d-48a9-93c9-e0122713536e', 'volume_name': 'volume-23e6631d-7b3d-48a9-93c9-e0122713536e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11919278-6d9c-480a-af6c-e34d8dcf11db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11919278-6d9c-480a-af6c-e34d8dcf11db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b3cc88-d74a-4561-a645-88a3ebb1d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume 23e6631d-7b3d-48a9-93c9-e0122713536e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e6631d-7b3d-48a9-93c9-e0122713536e', 'volume_size': 1} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708806184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e6631d-7b3d-48a9-93c9-e0122713536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume 23e6631d-7b3d-48a9-93c9-e0122713536e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:35 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:35 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e 1073741824 Sep 25 16:23:35 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:35 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e 1073741824" returned: 0 in 0.504s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=130,cinder:UPDATE=173,cinder:DELETE=12,cinder:INSERT=55 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:35 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=137,cinder:INSERT=43,cinder:UPDATE=172,cinder:DELETE=14 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:36 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e Sep 25 16:23:36 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:36 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b3cc88-d74a-4561-a645-88a3ebb1d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e6631d-7b3d-48a9-93c9-e0122713536e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca8019-1a95-49d2-8f8a-37593a23edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-23e6631d-7b3d-48a9-93c9-e0122713536e (23e6631d-7b3d-48a9-93c9-e0122713536e): created successfully Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca8019-1a95-49d2-8f8a-37593a23edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (8962faf9-e3a2-4f31-8468-ccf02e3242b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f22a2f97-003a-4a67-a949-37f7bc5642e6 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (728c15d6-9ed1-46e0-a9ee-d2126edec3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baad6a5a-07dc-4370-92ee-a7d863214732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baad6a5a-07dc-4370-92ee-a7d863214732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274253139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc7b5da-0a0a-499b-ae66-9783f21c285a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:38Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f702629-6c3f-4b96-91a4-6879afe71f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f702629-6c3f-4b96-91a4-6879afe71f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcef4fce-a7ca-495c-abcc-4157cadd314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcef4fce-a7ca-495c-abcc-4157cadd314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc7b5da-0a0a-499b-ae66-9783f21c285a', 'volume_name': 'volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89873545-9607-439f-9fe8-2b58e0b47e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89873545-9607-439f-9fe8-2b58e0b47e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71921fdd-fd94-4587-939a-036b1dd5d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume fbc7b5da-0a0a-499b-ae66-9783f21c285a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a', 'volume_size': 1} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274253139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc7b5da-0a0a-499b-ae66-9783f21c285a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:38Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume fbc7b5da-0a0a-499b-ae66-9783f21c285a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:38 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a 1073741824 Sep 25 16:23:38 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (c6bc5c48-ae32-465b-be5a-f1eb619c6fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be7b2e-66d6-4bd2-b934-533267ebb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be7b2e-66d6-4bd2-b934-533267ebb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918232189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd18d6b-251d-4621-8b72-ded54aa62390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:38Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670098e4-78a0-479f-b695-9a907f33662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670098e4-78a0-479f-b695-9a907f33662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de005fa-499d-49ee-8cb3-940fe3fe7fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de005fa-499d-49ee-8cb3-940fe3fe7fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd18d6b-251d-4621-8b72-ded54aa62390', 'volume_name': 'volume-6cd18d6b-251d-4621-8b72-ded54aa62390', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa073c-8b7b-43bc-a862-a271d529497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa073c-8b7b-43bc-a862-a271d529497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e936646c-0ae0-4a7e-ac82-814831c369d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume 6cd18d6b-251d-4621-8b72-ded54aa62390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd18d6b-251d-4621-8b72-ded54aa62390', 'volume_size': 1} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:38 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a 1073741824" returned: 0 in 0.681s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:38 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a Sep 25 16:23:38 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (2fb5c27e-2914-4939-ab6f-c5dc3b158b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7058e4c-6fd8-4063-872a-7a0a0e422f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7058e4c-6fd8-4063-872a-7a0a0e422f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170141953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:39Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1af8573-7d5d-4cd1-85b5-c59286380e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1af8573-7d5d-4cd1-85b5-c59286380e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f19829c-c005-46a7-aa9d-565900984673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f19829c-c005-46a7-aa9d-565900984673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111', 'volume_name': 'volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9b3a01-11a9-4cbb-97fc-0512e6aa82f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9b3a01-11a9-4cbb-97fc-0512e6aa82f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a5f93-aa57-49e7-ac1b-7dad84d1a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume 4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111', 'volume_size': 1} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:39 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a" returned: 0 in 0.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918232189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd18d6b-251d-4621-8b72-ded54aa62390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:38Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume 6cd18d6b-251d-4621-8b72-ded54aa62390 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:39 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 1073741824 Sep 25 16:23:39 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71921fdd-fd94-4587-939a-036b1dd5d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcd7234-bfd2-40b3-9af2-4fae677b5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a (fbc7b5da-0a0a-499b-ae66-9783f21c285a): created successfully Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcd7234-bfd2-40b3-9af2-4fae677b5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (728c15d6-9ed1-46e0-a9ee-d2126edec3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9a78ed45-a3e1-46ed-b193-c249e6259626 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (57673bef-b5fb-4742-ae65-4ec6424f0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0783c1b-f85f-4ceb-8c3a-b2814d6d689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0783c1b-f85f-4ceb-8c3a-b2814d6d689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536136883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33613983-3a26-4677-a282-dae807aef9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:40Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5445dd09-e0ac-46bc-98ab-cd1c4c28be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5445dd09-e0ac-46bc-98ab-cd1c4c28be4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae20400-5089-4032-9272-7cca969e6296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae20400-5089-4032-9272-7cca969e6296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33613983-3a26-4677-a282-dae807aef9da', 'volume_name': 'volume-33613983-3a26-4677-a282-dae807aef9da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c60d257-35aa-4dea-a7c7-2488a2a8b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c60d257-35aa-4dea-a7c7-2488a2a8b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a621f4-62c7-404e-ad12-1a6e691f7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume 33613983-3a26-4677-a282-dae807aef9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33613983-3a26-4677-a282-dae807aef9da', 'volume_size': 1} Sep 25 16:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:40 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 1073741824" returned: 0 in 0.755s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:40 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 Sep 25 16:23:40 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (8f4435b8-defa-43c1-aa7d-02d603a0cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4842638-a412-4619-ac4d-6bfd464d83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4842638-a412-4619-ac4d-6bfd464d83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419233199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad2191c-638c-4276-b3a9-41650cdcbf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:40Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa1ce44-e4cc-4017-8d3d-1dc18a79da39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa1ce44-e4cc-4017-8d3d-1dc18a79da39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2c7ff3-dd34-463b-92ab-7f283239938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2c7ff3-dd34-463b-92ab-7f283239938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ad2191c-638c-4276-b3a9-41650cdcbf8a', 'volume_name': 'volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae783e-4da4-4db5-b806-3ae315c29f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae783e-4da4-4db5-b806-3ae315c29f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1066dd0c-dc45-4431-8dad-dcc8a1ffd477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume 6ad2191c-638c-4276-b3a9-41650cdcbf8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a', 'volume_size': 1} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:40 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390" returned: 0 in 0.401s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170141953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:39Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume 4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:40 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 1073741824 Sep 25 16:23:40 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e936646c-0ae0-4a7e-ac82-814831c369d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd18d6b-251d-4621-8b72-ded54aa62390', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5134ed-1f7f-4606-9018-5324545233d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-6cd18d6b-251d-4621-8b72-ded54aa62390 (6cd18d6b-251d-4621-8b72-ded54aa62390): created successfully Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5134ed-1f7f-4606-9018-5324545233d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (c6bc5c48-ae32-465b-be5a-f1eb619c6fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d0375a7-dedf-4f72-8df3-d5e87d502b91 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:41 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 1073741824" returned: 0 in 0.540s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:41 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 Sep 25 16:23:41 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:41 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536136883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33613983-3a26-4677-a282-dae807aef9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:40Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume 33613983-3a26-4677-a282-dae807aef9da {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a5f93-aa57-49e7-ac1b-7dad84d1a96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745fdee0-1004-4a1f-b283-6c5611b15843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:41 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da 1073741824 Sep 25 16:23:41 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 (4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111): created successfully Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745fdee0-1004-4a1f-b283-6c5611b15843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (2fb5c27e-2914-4939-ab6f-c5dc3b158b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e62f11b9-ebbf-41f5-b300-0c2d681c4beb tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:42 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da 1073741824" returned: 0 in 0.542s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:42 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da Sep 25 16:23:42 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:42 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419233199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad2191c-638c-4276-b3a9-41650cdcbf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f93f65a0845dbaf3cbf902095c6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:40Z,use_quota=True,user_id='72d97d8f5273456a869c3dd85cebb0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Creating volume 6ad2191c-638c-4276-b3a9-41650cdcbf8a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a621f4-62c7-404e-ad12-1a6e691f7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33613983-3a26-4677-a282-dae807aef9da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7133e2-e114-4c74-a7d1-5635e9a37279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a 1073741824 Sep 25 16:23:42 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-33613983-3a26-4677-a282-dae807aef9da (33613983-3a26-4677-a282-dae807aef9da): created successfully Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7133e2-e114-4c74-a7d1-5635e9a37279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (57673bef-b5fb-4742-ae65-4ec6424f0546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4333166c-7801-43f3-8e08-4207ae4050b7 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (7579c914-6d05-4de1-a197-2871d30aa86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b85648-c761-4fa6-8147-c4405e4ea87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b85648-c761-4fa6-8147-c4405e4ea87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955160716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:43Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a06f7b52-49ae-4820-9966-430c71680865),volume_type_id=a06f7b52-49ae-4820-9966-430c71680865)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecdba5-0b13-4200-9004-e9de1bdd005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecdba5-0b13-4200-9004-e9de1bdd005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483a4b8f-d7c2-49a9-a2a5-7b778b97b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483a4b8f-d7c2-49a9-a2a5-7b778b97b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd', 'volume_name': 'volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b604a53-b440-45c9-b233-f44be3d04c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b604a53-b440-45c9-b233-f44be3d04c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bba37-4ce1-4877-91fa-ceccad65104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Volume 1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd', 'volume_size': 1} Sep 25 16:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a 1073741824" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:43 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a Sep 25 16:23:43 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (00705e94-b6d2-480e-a470-10edb99f2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d6cc0-5b00-43c3-b664-f5d49f60d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d6cc0-5b00-43c3-b664-f5d49f60d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784093994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f5eb13-f945-4f10-b32d-b794f1db2474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:43Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3d52b67-e03f-48af-a6db-3f520c12ab0c),volume_type_id=c3d52b67-e03f-48af-a6db-3f520c12ab0c)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3b3ec-c62d-4db9-96e7-4c3dac26f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3b3ec-c62d-4db9-96e7-4c3dac26f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ba60ac-f763-4bd4-a772-0660290d04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ba60ac-f763-4bd4-a772-0660290d04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f5eb13-f945-4f10-b32d-b794f1db2474', 'volume_name': 'volume-72f5eb13-f945-4f10-b32d-b794f1db2474', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a6498-6757-4ebf-92dc-59b9c47771f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a6498-6757-4ebf-92dc-59b9c47771f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e24535-0f6f-4f23-b541-186ed328ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Volume 72f5eb13-f945-4f10-b32d-b794f1db2474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f5eb13-f945-4f10-b32d-b794f1db2474', 'volume_size': 1} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a" returned: 0 in 0.343s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955160716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:43Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a06f7b52-49ae-4820-9966-430c71680865),volume_type_id=a06f7b52-49ae-4820-9966-430c71680865)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Creating volume 1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1066dd0c-dc45-4431-8dad-dcc8a1ffd477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd 1073741824 Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ab890-3df7-4112-a8f2-5d9a240cdcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Volume volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a (6ad2191c-638c-4276-b3a9-41650cdcbf8a): created successfully Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ab890-3df7-4112-a8f2-5d9a240cdcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Flow 'volume_create_manager' (8f4435b8-defa-43c1-aa7d-02d603a0cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-650ee9bb-e0a4-4544-9886-bffefdda21b4 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created volume successfully. Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-6ad2191c-638c-4276-b3a9-41650cdcbf8a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-6ad2191c-638c-4276-b3a9-41650cdcbf8a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-6ad2191c-638c-4276-b3a9-41650cdcbf8a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-6ad2191c-638c-4276-b3a9-41650cdcbf8a" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (4cbb98d4-2a99-4191-9391-cc496f8a9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5402e8-3076-4ebf-bd2e-ff5d55526002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[273591bb-f026-4086-8776-f0a06975aac6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd 1073741824" returned: 0 in 0.598s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5402e8-3076-4ebf-bd2e-ff5d55526002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-732698913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4402662-40bb-43a9-b530-0e49c8676a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:44Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d7d7f2-8e3f-47c5-b1c5-ab99b0485e53),volume_type_id=49d7d7f2-8e3f-47c5-b1c5-ab99b0485e53)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6e2f7a-93a5-4da1-853e-01b75c0799a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6e2f7a-93a5-4da1-853e-01b75c0799a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf123a9-ba03-4532-af03-f1144a4ef047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd Sep 25 16:23:44 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a Sep 25 16:23:44 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf123a9-ba03-4532-af03-f1144a4ef047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4402662-40bb-43a9-b530-0e49c8676a1f', 'volume_name': 'volume-f4402662-40bb-43a9-b530-0e49c8676a1f', 'volume_size': 1, 'image_id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710421510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54db54515d334319b94fee763e358801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'created_at': datetime.datetime(2026, 9, 25, 14, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c159d0-5e27-4e52-8cc7-5a0181635f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c159d0-5e27-4e52-8cc7-5a0181635f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cf0671-6075-472d-a3e2-c39e2a6d997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Volume f4402662-40bb-43a9-b530-0e49c8676a1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4402662-40bb-43a9-b530-0e49c8676a1f', 'volume_size': 1, 'image_id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710421510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54db54515d334319b94fee763e358801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'created_at': datetime.datetime(2026, 9, 25, 14, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73/file', 'properties': {}}, 'image_service': } Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Trying to clone f4402662-40bb-43a9-b530-0e49c8676a1f from image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:23:44 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" returned: 0 in 0.298s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784093994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f5eb13-f945-4f10-b32d-b794f1db2474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:43Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3d52b67-e03f-48af-a6db-3f520c12ab0c),volume_type_id=c3d52b67-e03f-48af-a6db-3f520c12ab0c)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Creating volume 72f5eb13-f945-4f10-b32d-b794f1db2474 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bba37-4ce1-4877-91fa-ceccad65104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 1073741824 Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd72dd7f-f7bf-4054-a8b4-54c3ac155454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:44 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a" returned: 0 in 0.440s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Volume volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd (1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd): created successfully Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd72dd7f-f7bf-4054-a8b4-54c3ac155454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:44 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a Sep 25 16:23:44 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (7579c914-6d05-4de1-a197-2871d30aa86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f5342b17-1269-47dc-b568-634322ca1a4b tempest-TestInstancesWithCinderVolumes-710813935 None] Created volume successfully. Sep 25 16:23:44 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6ad2191c-638c-4276-b3a9-41650cdcbf8a" returned: 0 in 0.300s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-6ad2191c-638c-4276-b3a9-41650cdcbf8a" released by "delete_volume" :: held 0.823s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['9870dcaf-b6a7-4bdf-97f2-8eb736e5d06f', '63c9014a-ce4d-4ed4-b36d-19c594ac53ba', '9e96bdaf-c072-4e2b-bc5d-30573aa4654c', '2f21fdaf-6260-49f8-a6b1-bfebd54794ce'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:44 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 1073741824" returned: 0 in 0.516s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:45 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 Sep 25 16:23:45 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-33613983-3a26-4677-a282-dae807aef9da-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-33613983-3a26-4677-a282-dae807aef9da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-33613983-3a26-4677-a282-dae807aef9da" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-33613983-3a26-4677-a282-dae807aef9da" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e63b7-5fcf-4cb4-ada9-54e98bbcad0a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-88de54e8-e7ce-44a5-a90b-b7466afa291f tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-6ad2191c-638c-4276-b3a9-41650cdcbf8a-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:45 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e24535-0f6f-4f23-b541-186ed328ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f5eb13-f945-4f10-b32d-b794f1db2474', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:45 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da Sep 25 16:23:45 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e728be48-4b78-45d2-b04e-424f877c32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Volume volume-72f5eb13-f945-4f10-b32d-b794f1db2474 (72f5eb13-f945-4f10-b32d-b794f1db2474): created successfully Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e728be48-4b78-45d2-b04e-424f877c32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (00705e94-b6d2-480e-a470-10edb99f2949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-99ebf704-bb0e-48c4-97d6-038355f0c554 tempest-TestInstancesWithCinderVolumes-710813935 None] Created volume successfully. Sep 25 16:23:45 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da" returned: 0 in 0.467s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da Sep 25 16:23:45 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:46 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-33613983-3a26-4677-a282-dae807aef9da" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-33613983-3a26-4677-a282-dae807aef9da" released by "delete_volume" :: held 0.784s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['26a962ae-275f-4aa7-9e14-95d61149e858', '465212d4-008f-4a06-a887-2d225a6701ca', 'd99b1414-6a02-4b7f-8dc2-87054492ff56', '7d3c7b6c-30d4-40fc-841c-8bae10cdee57'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:46 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:46 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:46 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4a449a09-ea99-4285-82ef-be28de97e0ff tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-33613983-3a26-4677-a282-dae807aef9da-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54e5dd2-cae9-40dd-af83-c315f5c07c47]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:46 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 Sep 25 16:23:46 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:46 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" returned: 0 in 0.469s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:46 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111 Sep 25 16:23:46 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:47 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" returned: 0 in 0.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111" released by "delete_volume" :: held 0.789s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['a75e9331-9faf-4949-99f2-648357d3347b', '52d36906-0bec-48be-9396-2f64ecbd6c78', '86906da9-44ab-4dd9-887e-95271abfc86f', 'd5f04897-93aa-4b2f-9bb2-b3eec1f86297'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:47 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:47 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-6cd18d6b-251d-4621-8b72-ded54aa62390-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-6cd18d6b-251d-4621-8b72-ded54aa62390-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-6cd18d6b-251d-4621-8b72-ded54aa62390" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-6cd18d6b-251d-4621-8b72-ded54aa62390" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[964fa222-3d48-430d-95e8-fe1319bd0962]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:47 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.296s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b4cf221b-83d4-4ef8-b125-1adad26cb2b5 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-4dbb3d53-d836-4e0d-a2f9-2c5d3ae25111-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:47 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 Sep 25 16:23:47 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:48 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:48 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390 Sep 25 16:23:48 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:48 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6cd18d6b-251d-4621-8b72-ded54aa62390" returned: 0 in 0.260s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-6cd18d6b-251d-4621-8b72-ded54aa62390" released by "delete_volume" :: held 0.729s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['c0f48205-e486-48f5-b27e-a10f2a84cbd8', 'ec264cf1-7fb4-48d9-beda-3683487a5c8f', 'fe84187d-1aca-4524-86c0-2acff5c781af', '6e00ebd3-23df-4c37-8dcc-7f16f7fb5b4e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:48 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:48 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD, size 20.69 MB, duration 4.33 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:23:48 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Image download 20.69 MB at 4.78 MB/s Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f251f7cb-9087-421c-9845-f298e03154d2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-fbc7b5da-0a0a-499b-ae66-9783f21c285a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-fbc7b5da-0a0a-499b-ae66-9783f21c285a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-fbc7b5da-0a0a-499b-ae66-9783f21c285a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-fbc7b5da-0a0a-499b-ae66-9783f21c285a" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:48 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD Sep 25 16:23:48 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2666c-7aaf-4758-811c-55a2569a02c3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:48 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dc55f3f9-af88-48fe-9608-ad3655dec275 tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-6cd18d6b-251d-4621-8b72-ded54aa62390-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:49 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a Sep 25 16:23:49 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Temporary image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 is fetched for user a398de041f344249956fbb4c7fe7c3c9. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78f376-bba0-46ba-b2c9-eaac8ba373ef]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:49 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:49 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD Sep 25 16:23:49 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a Sep 25 16:23:49 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-732698913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4402662-40bb-43a9-b530-0e49c8676a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54db54515d334319b94fee763e358801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:44Z,use_quota=True,user_id='a398de041f344249956fbb4c7fe7c3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d7d7f2-8e3f-47c5-b1c5-ab99b0485e53),volume_type_id=49d7d7f2-8e3f-47c5-b1c5-ab99b0485e53)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Creating volume f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:49 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:49 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fbc7b5da-0a0a-499b-ae66-9783f21c285a" returned: 0 in 0.261s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1073741824 Sep 25 16:23:49 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-fbc7b5da-0a0a-499b-ae66-9783f21c285a" released by "delete_volume" :: held 0.729s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['271d7c4e-52c5-4318-a956-0049d93d380b', 'f74b81e9-ac39-42ea-a1e9-e5a069ce5027', 'd9a4cbbb-e90b-45a6-99ef-c2ca7fb3c433', 'b4a1d6bb-5dd1-49a4-8ee4-f8e0653dff49'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:49 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:49 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:49 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-23e6631d-7b3d-48a9-93c9-e0122713536e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1073741824" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-23e6631d-7b3d-48a9-93c9-e0122713536e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-40facef6-f2aa-445b-8661-d1ab6b6335ca tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-fbc7b5da-0a0a-499b-ae66-9783f21c285a-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "cinder-quobyte-23e6631d-7b3d-48a9-93c9-e0122713536e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:50 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f Sep 25 16:23:50 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-23e6631d-7b3d-48a9-93c9-e0122713536e" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a4d82-af24-4776-bc4e-63415a456a28]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:50 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e Sep 25 16:23:50 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:50 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Attempting download of 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 ((None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}])) to volume f4402662-40bb-43a9-b530-0e49c8676a1f. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1843684c-1460-47fe-83f0-9413737991e7]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:50 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a Sep 25 16:23:50 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:50 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e" returned: 0 in 0.394s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:50 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e Sep 25 16:23:50 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:50 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a" returned: 0 in 0.331s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:50 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-23e6631d-7b3d-48a9-93c9-e0122713536e" returned: 0 in 0.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-quobyte-23e6631d-7b3d-48a9-93c9-e0122713536e" released by "delete_volume" :: held 0.702s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:50 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a Sep 25 16:23:50 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Created reservations ['265fb7dc-c0f2-4c86-8d24-8dd4e8ced084', 'fdc5e9e4-b43b-4047-888e-d12d9b8457a6', 'b4c04777-a568-47cf-b5ea-3e97f4a37a43', 'f35ee628-1eef-4120-829c-93e9e693fdf2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:51 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:23:51 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:51 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a" returned: 1 in 0.416s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_bnkiyb9a' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fbcff7-9ffc-4cb8-a886-000e033b4b24]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:51 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD Sep 25 16:23:51 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:51 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.361s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Deleted volume successfully. Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9c445816-fd96-43bc-a23c-9fd74c4d014c tempest-CreateVolumesFromSourceVolumeTest-1709402283 None] Lock "cinder-23e6631d-7b3d-48a9-93c9-e0122713536e-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:51 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 was qcow2, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:51 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f Sep 25 16:23:51 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:53 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f" returned: 0 in 2.291s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:53 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9766fd5c-ecc2-43ef-9a2a-48b8bd347e73_gycwbg0pdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:23:53 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Converted 112.00 MB image at 48.85 MB/s Sep 25 16:23:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:53 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1G Sep 25 16:23:53 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:54 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f 1G" returned: 0 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Downloaded image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 ((None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}])) to volume f4402662-40bb-43a9-b530-0e49c8676a1f successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Temporary image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 for user a398de041f344249956fbb4c7fe7c3c9 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Marking volume f4402662-40bb-43a9-b530-0e49c8676a1f as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Copying metadata from image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 to f4402662-40bb-43a9-b530-0e49c8676a1f. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Creating volume glance metadata for volume f4402662-40bb-43a9-b530-0e49c8676a1f backed by image 9766fd5c-ecc2-43ef-9a2a-48b8bd347e73 with: {'image_id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'image_name': 'tempest-scenario-img--710421510', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cf0671-6075-472d-a3e2-c39e2a6d997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4402662-40bb-43a9-b530-0e49c8676a1f', 'volume_size': 1, 'image_id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710421510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54db54515d334319b94fee763e358801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9766fd5c-ecc2-43ef-9a2a-48b8bd347e73', 'created_at': datetime.datetime(2026, 9, 25, 14, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9766fd5c-ecc2-43ef-9a2a-48b8bd347e73/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e916f05a-2603-4d40-954e-fc239f91c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Volume volume-f4402662-40bb-43a9-b530-0e49c8676a1f (f4402662-40bb-43a9-b530-0e49c8676a1f): created successfully Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e916f05a-2603-4d40-954e-fc239f91c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Flow 'volume_create_manager' (4cbb98d4-2a99-4191-9391-cc496f8a9a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3cfc8333-4f86-4568-8ed5-c7476ce5f58c tempest-TestInstancesWithCinderVolumes-710813935 None] Created volume successfully. Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Flow 'volume_create_manager' (eab1a051-4fe8-4576-a141-bf6112540dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc16932-6b77-4ad2-ac03-3207bc352271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc16932-6b77-4ad2-ac03-3207bc352271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de15174-c4e6-4b0e-8df2-097fef8833ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092c2d15da7d44a390a2189d717cc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:55Z,use_quota=True,user_id='c7e5a7991b024faeba4088e45ac8e4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c350c63e-ad44-49be-be99-fbf17e597964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c350c63e-ad44-49be-be99-fbf17e597964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda79cb-4f19-4c8c-8ff2-f483f5596250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda79cb-4f19-4c8c-8ff2-f483f5596250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de15174-c4e6-4b0e-8df2-097fef8833ee', 'volume_name': 'volume-0de15174-c4e6-4b0e-8df2-097fef8833ee', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1599dc37-5467-4493-8607-4b497b6f7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1599dc37-5467-4493-8607-4b497b6f7fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb24ff-d0fe-4732-ae57-336884362ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Volume 0de15174-c4e6-4b0e-8df2-097fef8833ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de15174-c4e6-4b0e-8df2-097fef8833ee', 'volume_size': 1} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de15174-c4e6-4b0e-8df2-097fef8833ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092c2d15da7d44a390a2189d717cc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:55Z,use_quota=True,user_id='c7e5a7991b024faeba4088e45ac8e4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Creating volume 0de15174-c4e6-4b0e-8df2-097fef8833ee {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:54 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee 1073741824 Sep 25 16:23:54 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:55 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee 1073741824" returned: 0 in 0.495s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:55 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee Sep 25 16:23:55 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:55 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb24ff-d0fe-4732-ae57-336884362ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de15174-c4e6-4b0e-8df2-097fef8833ee', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5005d5bd-973f-4b49-97b8-35b08fc1a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Volume volume-0de15174-c4e6-4b0e-8df2-097fef8833ee (0de15174-c4e6-4b0e-8df2-097fef8833ee): created successfully Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5005d5bd-973f-4b49-97b8-35b08fc1a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Flow 'volume_create_manager' (eab1a051-4fe8-4576-a141-bf6112540dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-549f4f3d-20f5-47a5-9bc3-d3badee5bfbb tempest-CinderUnicodeTest-955787722 None] Created volume successfully. Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Flow 'volume_create_manager' (00e08901-54ed-4cf2-8e45-52199bd21fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2946ba57-dcf4-4e7b-b8c1-e64048fcafa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2946ba57-dcf4-4e7b-b8c1-e64048fcafa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-77146454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885cb1e7-59b1-4794-a1da-98f59bbd8faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092c2d15da7d44a390a2189d717cc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:57Z,use_quota=True,user_id='c7e5a7991b024faeba4088e45ac8e4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384feddf-a7d6-4306-a35e-3f4b73508217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384feddf-a7d6-4306-a35e-3f4b73508217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d394dc25-fc36-414d-ba77-03a3c455fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d394dc25-fc36-414d-ba77-03a3c455fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885cb1e7-59b1-4794-a1da-98f59bbd8faf', 'volume_name': 'volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e15e70b-973a-4e73-a0a8-678915445766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e15e70b-973a-4e73-a0a8-678915445766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fad3b1-ee65-4f8c-bc99-954f18b56fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Volume 885cb1e7-59b1-4794-a1da-98f59bbd8faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf', 'volume_size': 1} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-77146454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885cb1e7-59b1-4794-a1da-98f59bbd8faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092c2d15da7d44a390a2189d717cc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:57Z,use_quota=True,user_id='c7e5a7991b024faeba4088e45ac8e4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Creating volume 885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-a2bf751a-cb23-4932-859c-469a8801c25f req-0c2f0519-9b7f-484d-826b-4507a7af8266 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:57 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf 1073741824 Sep 25 16:23:57 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:58 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf 1073741824" returned: 0 in 0.636s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:58 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf Sep 25 16:23:58 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:58 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-a2bf751a-cb23-4932-859c-469a8801c25f req-0c2f0519-9b7f-484d-826b-4507a7af8266 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.996s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-a2bf751a-cb23-4932-859c-469a8801c25f req-0c2f0519-9b7f-484d-826b-4507a7af8266 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fad3b1-ee65-4f8c-bc99-954f18b56fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5fc5a2-8b32-4f49-82b7-f286d5b1dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Volume volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf (885cb1e7-59b1-4794-a1da-98f59bbd8faf): created successfully Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5fc5a2-8b32-4f49-82b7-f286d5b1dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Flow 'volume_create_manager' (00e08901-54ed-4cf2-8e45-52199bd21fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-a2bf751a-cb23-4932-859c-469a8801c25f req-0c2f0519-9b7f-484d-826b-4507a7af8266 tempest-TestInstancesWithCinderVolumes-710813935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-f4402662-40bb-43a9-b530-0e49c8676a1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11b37056-9d23-48a7-8b54-d5edfce0115f', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:23:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-86d3a79e-c9c9-4bc7-a8fb-da4bac617c4a tempest-CinderUnicodeTest-955787722 None] Created volume successfully. Sep 25 16:23:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-a2bf751a-cb23-4932-859c-469a8801c25f req-0c2f0519-9b7f-484d-826b-4507a7af8266 tempest-TestInstancesWithCinderVolumes-710813935 None] attachment_update completed successfully. Sep 25 16:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Creating offline snapshot b5504d99-ea1a-4e88-a827-ae22438bee9e of volume 885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:23:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e144c-84ff-4fd9-b412-41d148fa9f5d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:00 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf Sep 25 16:24:00 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:00 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf" returned: 0 in 0.507s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:00 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e 1G Sep 25 16:24:00 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:01 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e 1G" returned: 0 in 0.853s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:01 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e Sep 25 16:24:01 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:01 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e" returned: 0 in 0.462s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:01 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e is being set with open permissions: ugo+rw Sep 25 16:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:01 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e Sep 25 16:24:01 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e" returned: 0 in 0.288s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:02 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info Sep 25 16:24:02 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info" returned: 0 in 0.306s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info is being set with open permissions: ugo+rw Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:02 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info Sep 25 16:24:02 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.info" returned: 0 in 0.343s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f4ac3f39-69fa-4ebd-be25-a83d5f8a3b54 tempest-CinderUnicodeTest-955787722 None] Create snapshot completed successfully Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-b5504d99-ea1a-4e88-a827-ae22438bee9e-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-b5504d99-ea1a-4e88-a827-ae22438bee9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-quobyte-b5504d99-ea1a-4e88-a827-ae22438bee9e" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-b5504d99-ea1a-4e88-a827-ae22438bee9e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Deleting offline snapshot b5504d99-ea1a-4e88-a827-ae22438bee9e of volume 885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] snapshot_file for this snap is: volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95fae5c-153a-445c-8aec-5fe0c9634a9a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e Sep 25 16:24:03 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:03 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e" returned: 0 in 0.452s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd2e8c-8657-464c-9153-0830659c2d82]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf Sep 25 16:24:03 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf" returned: 0 in 0.513s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:04 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e Sep 25 16:24:04 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e" returned: 0 in 0.425s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:04 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e Sep 25 16:24:04 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf.b5504d99-ea1a-4e88-a827-ae22438bee9e" returned: 0 in 0.325s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-b5504d99-ea1a-4e88-a827-ae22438bee9e" released by "_delete_snapshot" :: held 1.893s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" released by "delete_snapshot" :: held 1.926s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Created reservations ['d515d1e0-2be8-4c47-b6d0-0d0d6d97302c', 'c57d80b9-53fd-49ec-9212-596a312c9479', '342735cd-24e5-49e8-8cab-547637b53ba6', 'c78f051f-2238-4147-8cd7-173c0c3aff7c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Delete snapshot completed successfully. Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06f8f066-63de-4823-a827-194d6a1f783a tempest-CinderUnicodeTest-955787722 None] Lock "cinder-b5504d99-ea1a-4e88-a827-ae22438bee9e-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-885cb1e7-59b1-4794-a1da-98f59bbd8faf-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "cinder-885cb1e7-59b1-4794-a1da-98f59bbd8faf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b1021a-3c4e-4bbb-bc70-ab2be3c98eb3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:05 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf Sep 25 16:24:05 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:05 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf" returned: 0 in 0.529s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:06 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf Sep 25 16:24:06 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:06 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:06 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:06 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-885cb1e7-59b1-4794-a1da-98f59bbd8faf" returned: 0 in 0.387s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-885cb1e7-59b1-4794-a1da-98f59bbd8faf" released by "delete_volume" :: held 1.055s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Created reservations ['658be03d-5f56-4786-ad20-a9982bceb9db', 'c8aef4f9-b2d2-4377-b503-bbbab1ba770d', '15380892-d314-4bd3-92b9-f01dedcc1866', '61d85c08-3989-424b-8a37-19264463487a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:06 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.597s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:06 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:06 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:07 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.334s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Deleted volume successfully. Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6085d674-4208-4c75-8f5d-06b6f98a960e tempest-CinderUnicodeTest-955787722 None] Lock "cinder-885cb1e7-59b1-4794-a1da-98f59bbd8faf-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-0de15174-c4e6-4b0e-8df2-097fef8833ee-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "cinder-0de15174-c4e6-4b0e-8df2-097fef8833ee-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Acquiring lock "cinder-quobyte-0de15174-c4e6-4b0e-8df2-097fef8833ee" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-0de15174-c4e6-4b0e-8df2-097fef8833ee" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d91ca-5350-4dab-b15b-7921ff1f1b78]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:08 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee Sep 25 16:24:08 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:08 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee" returned: 0 in 0.562s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:08 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee Sep 25 16:24:08 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:08 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0de15174-c4e6-4b0e-8df2-097fef8833ee" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "cinder-quobyte-0de15174-c4e6-4b0e-8df2-097fef8833ee" released by "delete_volume" :: held 0.992s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Created reservations ['5baef28e-b949-48b3-a972-dbb038a2fee7', 'bc6946a2-8557-4409-8056-f6c20d756278', 'ab635a99-5baa-4510-b46c-1550965913b5', '7425453b-8827-412d-a144-c24a66281c73'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:09 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:09 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:09 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Deleted volume successfully. Sep 25 16:24:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-29e5b9f1-40d5-4efa-b501-ba08895a7238 tempest-CinderUnicodeTest-955787722 None] Lock "cinder-0de15174-c4e6-4b0e-8df2-097fef8833ee-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=99,cinder:SELECT=85,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=78,cinder:INSERT=26,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ee69b14f-983b-4cbb-92b4-176d549e1535 req-c1f649a5-5532-4f94-8534-64410fa3adfa tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ee69b14f-983b-4cbb-92b4-176d549e1535 req-c1f649a5-5532-4f94-8534-64410fa3adfa tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ee69b14f-983b-4cbb-92b4-176d549e1535 req-c1f649a5-5532-4f94-8534-64410fa3adfa tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ee69b14f-983b-4cbb-92b4-176d549e1535 req-c1f649a5-5532-4f94-8534-64410fa3adfa tempest-TestInstancesWithCinderVolumes-710813935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1edc857b-4d91-4b58-a46a-19548aea5acd', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:24:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ee69b14f-983b-4cbb-92b4-176d549e1535 req-c1f649a5-5532-4f94-8534-64410fa3adfa tempest-TestInstancesWithCinderVolumes-710813935 None] attachment_update completed successfully. Sep 25 16:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f1abe2ff-a4a5-485f-8766-3c5d5faee896 req-c315a685-dae2-40d7-a44e-381dab3054da tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f1abe2ff-a4a5-485f-8766-3c5d5faee896 req-c315a685-dae2-40d7-a44e-381dab3054da tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-f1abe2ff-a4a5-485f-8766-3c5d5faee896 req-c315a685-dae2-40d7-a44e-381dab3054da tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-f1abe2ff-a4a5-485f-8766-3c5d5faee896 req-c315a685-dae2-40d7-a44e-381dab3054da tempest-TestInstancesWithCinderVolumes-710813935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-72f5eb13-f945-4f10-b32d-b794f1db2474', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c14fe0d-152c-4a06-bda0-2fa61bc9f469', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:24:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-f1abe2ff-a4a5-485f-8766-3c5d5faee896 req-c315a685-dae2-40d7-a44e-381dab3054da tempest-TestInstancesWithCinderVolumes-710813935 None] attachment_update completed successfully. Sep 25 16:24:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0a04bcb6-c843-4dd8-acf2-bdc305aff4a4 req-0da0b660-6261-4d51-989e-34bb5c499f80 tempest-TestInstancesWithCinderVolumes-710813935 None] Terminate volume connection completed successfully. Sep 25 16:24:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0a04bcb6-c843-4dd8-acf2-bdc305aff4a4 req-0da0b660-6261-4d51-989e-34bb5c499f80 tempest-TestInstancesWithCinderVolumes-710813935 None] Deleting attachment 1edc857b-4d91-4b58-a46a-19548aea5acd. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-quobyte-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548aba3-3057-4c17-8083-2db6f8af0ec7]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:42 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd Sep 25 16:24:42 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:43 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd Sep 25 16:24:43 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" returned: 0 in 0.311s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd" released by "delete_volume" :: held 0.876s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:43 devstack cinder-volume[87199]: WARNING cinder.quota [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-92175970-1573304962 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-92175970-1573304962, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:43 devstack cinder-volume[87199]: WARNING cinder.quota [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-92175970-1573304962 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-92175970-1573304962, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Created reservations ['5bfde27f-316c-4f07-8b95-de30e849fdc8', '51004503-b288-49d9-a1c0-1e28f5851b62', '6f7640f3-bc79-44ce-a934-d3ad2382841e', 'bdfcc574-b240-47ea-ac11-14704d0b77c9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:43 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:43 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:44 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Deleted volume successfully. Sep 25 16:24:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15917e2f-c64d-4042-9a9d-1f7a60cd058b tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-1e3a16d5-632e-4eac-b6fc-18b6b72ff3cd-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-3eab3fcb-e369-4d3b-8a1c-97ccb332cfd1 req-0a570f36-7b55-4921-9b7c-f2f8ad4c121e tempest-TestInstancesWithCinderVolumes-710813935 None] Terminate volume connection completed successfully. Sep 25 16:24:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-3eab3fcb-e369-4d3b-8a1c-97ccb332cfd1 req-0a570f36-7b55-4921-9b7c-f2f8ad4c121e tempest-TestInstancesWithCinderVolumes-710813935 None] Deleting attachment 0c14fe0d-152c-4a06-bda0-2fa61bc9f469. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-72f5eb13-f945-4f10-b32d-b794f1db2474-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-72f5eb13-f945-4f10-b32d-b794f1db2474-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-quobyte-72f5eb13-f945-4f10-b32d-b794f1db2474" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-72f5eb13-f945-4f10-b32d-b794f1db2474" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd7768-be47-4a0b-88eb-95f47e443f39]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:47 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 Sep 25 16:24:47 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:48 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:48 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474 Sep 25 16:24:48 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:48 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-72f5eb13-f945-4f10-b32d-b794f1db2474" returned: 0 in 0.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-72f5eb13-f945-4f10-b32d-b794f1db2474" released by "delete_volume" :: held 0.732s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:48 devstack cinder-volume[87199]: WARNING cinder.quota [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943146837-1872895203 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943146837-1872895203, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:48 devstack cinder-volume[87199]: WARNING cinder.quota [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943146837-1872895203 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943146837-1872895203, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Created reservations ['082165b3-4fb1-42e8-88a4-945c3db03cb4', 'cfa8d3e9-4a03-48e1-8099-f4ee994890b1', '3fe686e4-d99d-4150-874e-3362ed668ea9', 'e4011d7c-86de-4656-8779-52d4b192b019'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:48 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:48 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:48 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.298s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Deleted volume successfully. Sep 25 16:24:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-07ebe044-14c0-4c15-a43d-209f91a34f75 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-72f5eb13-f945-4f10-b32d-b794f1db2474-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0ba3b5f5-7aee-4ab6-b18a-0eda8b6912e6 req-ff5a80cf-dacf-4fda-b66f-1fd1101da974 tempest-TestInstancesWithCinderVolumes-710813935 None] Terminate volume connection completed successfully. Sep 25 16:24:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0ba3b5f5-7aee-4ab6-b18a-0eda8b6912e6 req-ff5a80cf-dacf-4fda-b66f-1fd1101da974 tempest-TestInstancesWithCinderVolumes-710813935 None] Deleting attachment 11b37056-9d23-48a7-8b54-d5edfce0115f. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-f4402662-40bb-43a9-b530-0e49c8676a1f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-f4402662-40bb-43a9-b530-0e49c8676a1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "cinder-quobyte-f4402662-40bb-43a9-b530-0e49c8676a1f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-f4402662-40bb-43a9-b530-0e49c8676a1f" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5249e-bab9-495a-9d11-7dfa10503ec7]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:53 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f Sep 25 16:24:53 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:53 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:53 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f Sep 25 16:24:53 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:53 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f4402662-40bb-43a9-b530-0e49c8676a1f" returned: 0 in 0.242s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-quobyte-f4402662-40bb-43a9-b530-0e49c8676a1f" released by "delete_volume" :: held 0.655s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:53 devstack cinder-volume[87199]: WARNING cinder.quota [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296506950-435802723 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296506950-435802723, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:53 devstack cinder-volume[87199]: WARNING cinder.quota [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296506950-435802723 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296506950-435802723, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Created reservations ['b4f52ab8-9397-4498-adf5-857ac4f61447', '55d89388-4200-4eed-8001-aaa4738ff30c', 'f11b92d3-4cc6-4175-97cd-25cd7e4e6998', '708b7427-4fef-424f-a823-0f0509c22741'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:53 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:24:53 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:53 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Deleted volume successfully. Sep 25 16:24:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd2c26b4-2ea8-427e-b62d-cd25fb86fb39 tempest-TestInstancesWithCinderVolumes-710813935 None] Lock "cinder-f4402662-40bb-43a9-b530-0e49c8676a1f-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:03 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:03 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:06 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:25:06 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:06 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Flow 'volume_create_manager' (08a68527-dc81-4327-82d7-bc33b11d3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee2f953-2fb6-4e40-a6a0-760e19445567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee2f953-2fb6-4e40-a6a0-760e19445567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1167870251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ff19f8-25db-4ea5-b474-6b0c8677cd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695387ca4d9644c5b09050bcbc760065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:30Z,use_quota=True,user_id='11df365d654941eb9b295c657c400103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540bcaa3-98e5-4dde-a41a-fe28d19da33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540bcaa3-98e5-4dde-a41a-fe28d19da33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86998fc1-452d-4ccc-b2a0-7f06652162f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86998fc1-452d-4ccc-b2a0-7f06652162f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ff19f8-25db-4ea5-b474-6b0c8677cd41', 'volume_name': 'volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8748240-63de-48af-9566-270956aa8e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8748240-63de-48af-9566-270956aa8e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad95c58f-eddb-4f23-b7f6-deef460219b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume 62ff19f8-25db-4ea5-b474-6b0c8677cd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41', 'volume_size': 1} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1167870251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ff19f8-25db-4ea5-b474-6b0c8677cd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695387ca4d9644c5b09050bcbc760065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:30Z,use_quota=True,user_id='11df365d654941eb9b295c657c400103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Creating volume 62ff19f8-25db-4ea5-b474-6b0c8677cd41 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:30 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:30 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 1073741824 Sep 25 16:25:30 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Flow 'volume_create_manager' (46efa0a9-4d74-4525-b941-820ead726bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da4686-ed86-4016-8500-a4332d0ca35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da4686-ed86-4016-8500-a4332d0ca35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1917493557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecd62f7-05c6-4207-a4ce-a054e431a2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695387ca4d9644c5b09050bcbc760065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:31Z,use_quota=True,user_id='11df365d654941eb9b295c657c400103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b50ecc-dc85-41a9-8945-9546ac4f94c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b50ecc-dc85-41a9-8945-9546ac4f94c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980a3f45-7026-4f44-910b-5c2e745cae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980a3f45-7026-4f44-910b-5c2e745cae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecd62f7-05c6-4207-a4ce-a054e431a2b0', 'volume_name': 'volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fed5e5-5a9f-4977-8f52-b5c581dd0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fed5e5-5a9f-4977-8f52-b5c581dd0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce10a390-178f-47af-be24-8a0897bcb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume 5ecd62f7-05c6-4207-a4ce-a054e431a2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0', 'volume_size': 1} Sep 25 16:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:31 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 1073741824" returned: 0 in 0.608s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:31 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 Sep 25 16:25:31 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41" returned: 0 in 0.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1917493557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecd62f7-05c6-4207-a4ce-a054e431a2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695387ca4d9644c5b09050bcbc760065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:31Z,use_quota=True,user_id='11df365d654941eb9b295c657c400103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Creating volume 5ecd62f7-05c6-4207-a4ce-a054e431a2b0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad95c58f-eddb-4f23-b7f6-deef460219b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377e16c7-8354-455f-b480-3c8f8069843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:31 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 1073741824 Sep 25 16:25:31 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 (62ff19f8-25db-4ea5-b474-6b0c8677cd41): created successfully Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377e16c7-8354-455f-b480-3c8f8069843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Flow 'volume_create_manager' (08a68527-dc81-4327-82d7-bc33b11d3793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-15c918f1-47f9-404a-b44a-b94863b2e97c tempest-TestServerVolumeAttachmentScenario-1581872974 None] Created volume successfully. Sep 25 16:25:32 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 1073741824" returned: 0 in 0.632s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:32 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 Sep 25 16:25:32 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:32 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce10a390-178f-47af-be24-8a0897bcb739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0856bcf9-0348-4e00-9d21-944667c39354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Volume volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 (5ecd62f7-05c6-4207-a4ce-a054e431a2b0): created successfully Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0856bcf9-0348-4e00-9d21-944667c39354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Flow 'volume_create_manager' (46efa0a9-4d74-4525-b941-820ead726bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8c1693b1-1ef2-407a-b72d-8a4ec4d37dd2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Created volume successfully. Sep 25 16:25:42 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:42 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b4e53f9c-baa7-4774-9718-e831b6a59970 req-da276482-8466-4782-b4cd-7501aeb0cfe2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b4e53f9c-baa7-4774-9718-e831b6a59970 req-da276482-8466-4782-b4cd-7501aeb0cfe2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b4e53f9c-baa7-4774-9718-e831b6a59970 req-da276482-8466-4782-b4cd-7501aeb0cfe2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-b4e53f9c-baa7-4774-9718-e831b6a59970 req-da276482-8466-4782-b4cd-7501aeb0cfe2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a713e421-b632-43ba-9c9e-cdfcf5ad9399', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:26:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-b4e53f9c-baa7-4774-9718-e831b6a59970 req-da276482-8466-4782-b4cd-7501aeb0cfe2 tempest-TestServerVolumeAttachmentScenario-1581872974 None] attachment_update completed successfully. Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:06 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:26:06 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:06 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:26:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b0b8f9e-dcb8-4760-ac4b-c14cfd1f1b4d req-7278a7f1-736d-41c5-9024-ab1335a04a18 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b0b8f9e-dcb8-4760-ac4b-c14cfd1f1b4d req-7278a7f1-736d-41c5-9024-ab1335a04a18 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b0b8f9e-dcb8-4760-ac4b-c14cfd1f1b4d req-7278a7f1-736d-41c5-9024-ab1335a04a18 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5b0b8f9e-dcb8-4760-ac4b-c14cfd1f1b4d req-7278a7f1-736d-41c5-9024-ab1335a04a18 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '834eaa5b-0eb0-4c6c-9207-fdef0eeb3a6b', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:26:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5b0b8f9e-dcb8-4760-ac4b-c14cfd1f1b4d req-7278a7f1-736d-41c5-9024-ab1335a04a18 tempest-TestServerVolumeAttachmentScenario-1581872974 None] attachment_update completed successfully. Sep 25 16:26:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0d90a77e-c56e-41d9-a8fa-07a082c91dbe req-788debc5-d8c1-4231-821d-27860d024604 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Terminate volume connection completed successfully. Sep 25 16:26:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0d90a77e-c56e-41d9-a8fa-07a082c91dbe req-788debc5-d8c1-4231-821d-27860d024604 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Deleting attachment 834eaa5b-0eb0-4c6c-9207-fdef0eeb3a6b. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:26:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-dd62df97-87ca-4acb-9fc2-78d22168b9b6 req-bc0860e4-1c76-4d38-b0a6-afd5fe40cbae tempest-TestServerVolumeAttachmentScenario-1581872974 None] Terminate volume connection completed successfully. Sep 25 16:26:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-dd62df97-87ca-4acb-9fc2-78d22168b9b6 req-bc0860e4-1c76-4d38-b0a6-afd5fe40cbae tempest-TestServerVolumeAttachmentScenario-1581872974 None] Deleting attachment a713e421-b632-43ba-9c9e-cdfcf5ad9399. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "cinder-5ecd62f7-05c6-4207-a4ce-a054e431a2b0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-5ecd62f7-05c6-4207-a4ce-a054e431a2b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "cinder-quobyte-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-quobyte-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9850c7-1e0e-4b5c-a9f1-49269faf8993]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:17 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 Sep 25 16:26:17 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:17 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:17 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0 Sep 25 16:26:17 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:17 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" returned: 0 in 0.259s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-quobyte-5ecd62f7-05c6-4207-a4ce-a054e431a2b0" released by "delete_volume" :: held 0.689s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Created reservations ['0c5cd630-e508-44dd-8a4c-8370b898f152', '6384eaa5-47e6-4b0f-b8c4-ec129c5f28f3', '796473e5-0241-4287-a2f3-5980f684d0b1', 'aa1ebb68-df82-4da1-8e55-dbbc0adb1b8c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:18 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:26:18 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:18 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "cinder-62ff19f8-25db-4ea5-b474-6b0c8677cd41-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Deleted volume successfully. Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-62ff19f8-25db-4ea5-b474-6b0c8677cd41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-84a94f06-1012-410c-a781-ee431040ab5b tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-5ecd62f7-05c6-4207-a4ce-a054e431a2b0-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "cinder-quobyte-62ff19f8-25db-4ea5-b474-6b0c8677cd41" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-quobyte-62ff19f8-25db-4ea5-b474-6b0c8677cd41" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3f4d9-cd1c-4310-b360-77f36a36acdd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:18 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 Sep 25 16:26:18 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:18 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41" returned: 0 in 0.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:18 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41 Sep 25 16:26:18 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:19 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-62ff19f8-25db-4ea5-b474-6b0c8677cd41" returned: 0 in 0.254s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-quobyte-62ff19f8-25db-4ea5-b474-6b0c8677cd41" released by "delete_volume" :: held 0.679s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Created reservations ['1f1b05fb-5023-4c9a-9dd4-944ebdc4b1a1', 'afcf96ee-8cbd-4ac1-b069-45e8e1e1bb74', '99a2a1e8-ba6f-4d14-8244-4c35678c01d0', '32ccc856-9174-4b16-82fc-049d90eee3d2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:19 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:26:19 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:19 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.245s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Deleted volume successfully. Sep 25 16:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6d485c6-b84e-444b-814f-38986ef81b41 tempest-TestServerVolumeAttachmentScenario-1581872974 None] Lock "cinder-62ff19f8-25db-4ea5-b474-6b0c8677cd41-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:29 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=25,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:29 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Flow 'volume_create_manager' (fb67a0d9-1170-4768-9d72-a2b0d534b338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212e22c0-6f78-415e-838d-af56519e074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212e22c0-6f78-415e-838d-af56519e074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1656785100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b747aa7e-4438-42de-9146-8b609a88bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6a850852ac4659be35df428fe4ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:57Z,use_quota=True,user_id='89305bb166d0468e986774650867e2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121ece9b-8a4a-474b-9be6-dfd2443de80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121ece9b-8a4a-474b-9be6-dfd2443de80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916938d-7da2-4257-9e4d-3c42e2c9e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916938d-7da2-4257-9e4d-3c42e2c9e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b747aa7e-4438-42de-9146-8b609a88bfef', 'volume_name': 'volume-b747aa7e-4438-42de-9146-8b609a88bfef', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421d1161-aff5-4a83-b936-825c2eff59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421d1161-aff5-4a83-b936-825c2eff59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054cec12-5041-466b-80cb-05f1dfd62c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Volume b747aa7e-4438-42de-9146-8b609a88bfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b747aa7e-4438-42de-9146-8b609a88bfef', 'volume_size': 1} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1656785100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b747aa7e-4438-42de-9146-8b609a88bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6a850852ac4659be35df428fe4ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:57Z,use_quota=True,user_id='89305bb166d0468e986774650867e2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Creating volume b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:26:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef 1073741824 Sep 25 16:26:56 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef 1073741824" returned: 0 in 0.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:26:57 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.277s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054cec12-5041-466b-80cb-05f1dfd62c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b747aa7e-4438-42de-9146-8b609a88bfef', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b49113c-9969-44d7-937d-78e6ccbc70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Volume volume-b747aa7e-4438-42de-9146-8b609a88bfef (b747aa7e-4438-42de-9146-8b609a88bfef): created successfully Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b49113c-9969-44d7-937d-78e6ccbc70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Flow 'volume_create_manager' (fb67a0d9-1170-4768-9d72-a2b0d534b338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d7a5baa5-1492-41d1-855f-e103729d14f1 tempest-TestStampPattern-1534166674 None] Created volume successfully. Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:27:06 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:06 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.297s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:27:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:27:07 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:07 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b826cd3-caca-44cf-a783-77dc0f4e7b90 req-ff5fec45-b0df-4fab-9565-6e5c3179c218 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b826cd3-caca-44cf-a783-77dc0f4e7b90 req-ff5fec45-b0df-4fab-9565-6e5c3179c218 tempest-TestStampPattern-1534166674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-5b826cd3-caca-44cf-a783-77dc0f4e7b90 req-ff5fec45-b0df-4fab-9565-6e5c3179c218 tempest-TestStampPattern-1534166674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5b826cd3-caca-44cf-a783-77dc0f4e7b90 req-ff5fec45-b0df-4fab-9565-6e5c3179c218 tempest-TestStampPattern-1534166674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-b747aa7e-4438-42de-9146-8b609a88bfef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7eeb195-e7d8-4106-84b4-93100f00339c', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:27:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5b826cd3-caca-44cf-a783-77dc0f4e7b90 req-ff5fec45-b0df-4fab-9565-6e5c3179c218 tempest-TestStampPattern-1534166674 None] attachment_update completed successfully. Sep 25 16:27:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-fc9d6759-18a8-4030-8f0b-33320a1680e6 req-4c99c864-a65f-4452-ac81-8d9ccc5f0f42 tempest-TestStampPattern-1534166674 None] Terminate volume connection completed successfully. Sep 25 16:27:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-fc9d6759-18a8-4030-8f0b-33320a1680e6 req-4c99c864-a65f-4452-ac81-8d9ccc5f0f42 tempest-TestStampPattern-1534166674 None] Deleting attachment f7eeb195-e7d8-4106-84b4-93100f00339c. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:27:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Creating offline snapshot 57edce49-92f5-4a58-88ca-54d9a05bf729 of volume b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:27:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf0306-46b7-4c1b-afa3-7f8520521da2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:37 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:27:37 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:38 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.375s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 1G Sep 25 16:27:38 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:38 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 1G" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b747aa7e-4438-42de-9146-8b609a88bfef -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b747aa7e-4438-42de-9146-8b609a88bfef -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:27:38 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:38 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b747aa7e-4438-42de-9146-8b609a88bfef -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:38 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 is being set with open permissions: ugo+rw Sep 25 16:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:27:38 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:39 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info Sep 25 16:27:39 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info" returned: 0 in 0.276s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info is being set with open permissions: ugo+rw Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:39 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info Sep 25 16:27:39 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.info" returned: 0 in 0.250s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5d726596-ce60-4fed-a920-aff6491f89b7 tempest-TestStampPattern-1534166674 None] Create snapshot completed successfully Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Flow 'volume_create_manager' (449d262e-0ef3-4f4b-bd95-2a7235532b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb63bb7-5b03-4553-8d37-010f847210f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb63bb7-5b03-4553-8d37-010f847210f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1024894030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69aece87-a99c-4723-98dd-0cf2d2e1fc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6a850852ac4659be35df428fe4ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57edce49-92f5-4a58-88ca-54d9a05bf729,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:47Z,use_quota=True,user_id='89305bb166d0468e986774650867e2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53abc471-66b8-4dd4-bc9e-95b178586ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53abc471-66b8-4dd4-bc9e-95b178586ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90e469e-2399-4243-bd6a-f95686179242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90e469e-2399-4243-bd6a-f95686179242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69aece87-a99c-4723-98dd-0cf2d2e1fc78', 'volume_name': 'volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78', 'volume_size': 1, 'snapshot_id': '57edce49-92f5-4a58-88ca-54d9a05bf729'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bd92be-e452-45bf-a150-99ca13da5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bd92be-e452-45bf-a150-99ca13da5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4954a996-eca9-4054-94fa-297860cf7795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Volume 69aece87-a99c-4723-98dd-0cf2d2e1fc78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78', 'volume_size': 1, 'snapshot_id': '57edce49-92f5-4a58-88ca-54d9a05bf729'} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729-69aece87-a99c-4723-98dd-0cf2d2e1fc78" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729-69aece87-a99c-4723-98dd-0cf2d2e1fc78" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Creating volume 69aece87-a99c-4723-98dd-0cf2d2e1fc78 from snapshot 57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] snapshot: 57edce49-92f5-4a58-88ca-54d9a05bf729, volume: 69aece87-a99c-4723-98dd-0cf2d2e1fc78, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7964e0-7f1b-4f61-b0a2-a6746e15f17e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:47 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:27:47 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:47 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.434s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b747aa7e-4438-42de-9146-8b609a88bfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f8271-3382-4e7d-ad01-ede0a1fe3ace]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:47 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:27:47 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:47 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.446s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:47 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 Sep 25 16:27:47 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78" returned: 0 in 8.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:27:56 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Converted 1024.00 MB image at 120.57 MB/s Sep 25 16:27:56 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 is being set with open permissions: ugo+rw Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:56 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 Sep 25 16:27:56 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" released by "_copy_volume_from_snapshot" :: held 9.811s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729-69aece87-a99c-4723-98dd-0cf2d2e1fc78" released by "_create_volume_from_snapshot" :: held 9.892s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.910s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4954a996-eca9-4054-94fa-297860cf7795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78', 'volume_size': 1, 'snapshot_id': '57edce49-92f5-4a58-88ca-54d9a05bf729'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c4c47-439a-40b3-8242-4a90f02dcee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Volume volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 (69aece87-a99c-4723-98dd-0cf2d2e1fc78): created successfully Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c4c47-439a-40b3-8242-4a90f02dcee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Flow 'volume_create_manager' (449d262e-0ef3-4f4b-bd95-2a7235532b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3744add1-5f68-468c-afbe-d4c3d87e07b8 tempest-TestStampPattern-1534166674 None] Created volume successfully. Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:06 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:28:06 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:06 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.269s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:06 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ef08d23c-52fe-471f-a69f-d8d2836278b7 req-38955b43-24cb-40e9-b897-c748018457a9 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ef08d23c-52fe-471f-a69f-d8d2836278b7 req-38955b43-24cb-40e9-b897-c748018457a9 tempest-TestStampPattern-1534166674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ef08d23c-52fe-471f-a69f-d8d2836278b7 req-38955b43-24cb-40e9-b897-c748018457a9 tempest-TestStampPattern-1534166674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ef08d23c-52fe-471f-a69f-d8d2836278b7 req-38955b43-24cb-40e9-b897-c748018457a9 tempest-TestStampPattern-1534166674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1', 'name': 'volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2436d076-b649-48ea-9a86-f11f1d9cfaee', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:28:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ef08d23c-52fe-471f-a69f-d8d2836278b7 req-38955b43-24cb-40e9-b897-c748018457a9 tempest-TestStampPattern-1534166674 None] attachment_update completed successfully. Sep 25 16:28:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-a11fd70e-a908-4a30-b06d-cc3f94c4799d req-923a9584-bcf4-4d18-ac2e-86bf2bcea146 tempest-TestStampPattern-1534166674 None] Terminate volume connection completed successfully. Sep 25 16:28:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-a11fd70e-a908-4a30-b06d-cc3f94c4799d req-923a9584-bcf4-4d18-ac2e-86bf2bcea146 tempest-TestStampPattern-1534166674 None] Deleting attachment 2436d076-b649-48ea-9a86-f11f1d9cfaee. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:28:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-69aece87-a99c-4723-98dd-0cf2d2e1fc78-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "cinder-69aece87-a99c-4723-98dd-0cf2d2e1fc78-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0e945-9bc2-4dc8-b755-597e5f64040a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 Sep 25 16:28:45 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:45 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78" returned: 0 in 0.411s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78 Sep 25 16:28:45 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:45 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-69aece87-a99c-4723-98dd-0cf2d2e1fc78" returned: 0 in 0.252s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-69aece87-a99c-4723-98dd-0cf2d2e1fc78" released by "delete_volume" :: held 0.709s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Created reservations ['e570f779-757f-478a-be37-d8843ed52231', '4ec64471-2088-4772-a496-c4f97a81f8c3', 'b84da3ad-365f-4ddf-8a59-d35b230d10b1', '3b2979ee-639c-4c69-b416-8344f5b5e334'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:28:45 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.261s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Deleted volume successfully. Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e1c915-a083-489f-8fa5-8a5b4468d19d tempest-TestStampPattern-1534166674 None] Lock "cinder-69aece87-a99c-4723-98dd-0cf2d2e1fc78-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-57edce49-92f5-4a58-88ca-54d9a05bf729-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-57edce49-92f5-4a58-88ca-54d9a05bf729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Deleting offline snapshot 57edce49-92f5-4a58-88ca-54d9a05bf729 of volume b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] snapshot_file for this snap is: volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b76117-1ff7-41ce-bdff-1e8a962700e4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:46 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:28:46 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.343s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b747aa7e-4438-42de-9146-8b609a88bfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb571e-b61d-4792-a623-2a07c42936f9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:28:47 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:47 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.527s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:28:47 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:47 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.376s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729 Sep 25 16:28:47 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef.57edce49-92f5-4a58-88ca-54d9a05bf729" returned: 0 in 0.279s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-57edce49-92f5-4a58-88ca-54d9a05bf729" released by "_delete_snapshot" :: held 1.648s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" released by "delete_snapshot" :: held 1.709s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Created reservations ['2eca1b1e-0a0e-417b-baad-b8168e688dce', '6daf5b57-d876-4da4-b5dc-8351054116f4', '404fadc3-6edf-423c-b9e5-4259aef51b2e', '2c0281c8-5c05-4d84-993b-0a71d7f7fe3a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Delete snapshot completed successfully. Sep 25 16:28:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99844278-e2d0-40db-bfbc-6caaabef5cfa tempest-TestStampPattern-1534166674 None] Lock "cinder-57edce49-92f5-4a58-88ca-54d9a05bf729-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-b747aa7e-4438-42de-9146-8b609a88bfef-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "cinder-b747aa7e-4438-42de-9146-8b609a88bfef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Acquiring lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4782ac7-8df8-4185-8ba3-4f25cd9ecd09]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:28:52 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.355s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef Sep 25 16:28:53 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-b747aa7e-4438-42de-9146-8b609a88bfef" returned: 0 in 0.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "cinder-quobyte-b747aa7e-4438-42de-9146-8b609a88bfef" released by "delete_volume" :: held 0.677s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Created reservations ['9526c3fc-077e-4c40-a37f-6f4f10508bab', '74d3a512-fd81-4931-ab64-9c615fa211bc', '840874a9-d0b1-4f3c-ad75-91368ff4ff9b', 'd8730fc3-491c-4b52-b078-13e3034c4f21'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:28:53 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.243s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Deleted volume successfully. Sep 25 16:28:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-efe3bcf5-a446-408f-b94f-3330bc880707 tempest-TestStampPattern-1534166674 None] Lock "cinder-b747aa7e-4438-42de-9146-8b609a88bfef-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:03 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=22,cinder:UPDATE=20,cinder:INSERT=7 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:03 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:06 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:06 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:06 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Flow 'volume_create_manager' (390fd4d5-78ee-4bf4-8fba-0b11aa29bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72a738-70f5-4cd3-a963-b593f62d5c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72a738-70f5-4cd3-a963-b593f62d5c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2ad548-ec89-409b-a452-a08a7b9a73d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a68e2551364ce39187322b11faaee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:08Z,use_quota=True,user_id='f1ed622a72154e6ba03223fc1481bf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84510ad-668a-44e8-b485-4e4f713cd8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84510ad-668a-44e8-b485-4e4f713cd8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f058d039-4af4-442c-8be6-bfd04dfe3418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f058d039-4af4-442c-8be6-bfd04dfe3418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af2ad548-ec89-409b-a452-a08a7b9a73d0', 'volume_name': 'volume-af2ad548-ec89-409b-a452-a08a7b9a73d0', 'volume_size': 1, 'image_id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef2b34677491bab4738f88afd48cbe48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22a68e2551364ce39187322b11faaee2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59b68e420a9189ff7a83996df70c81d7dd9f996c660652eb1c3f67de60ede255feefa06a99933eea3e26191c2cd6ee4e6f20cab1a6ee886f8cbfe98101fe3649', 'id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be5f8eb-3b64-4923-856d-4ef81a8f9df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be5f8eb-3b64-4923-856d-4ef81a8f9df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92baa751-847c-46c7-9aed-e32778932617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Volume af2ad548-ec89-409b-a452-a08a7b9a73d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af2ad548-ec89-409b-a452-a08a7b9a73d0', 'volume_size': 1, 'image_id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef2b34677491bab4738f88afd48cbe48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22a68e2551364ce39187322b11faaee2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59b68e420a9189ff7a83996df70c81d7dd9f996c660652eb1c3f67de60ede255feefa06a99933eea3e26191c2cd6ee4e6f20cab1a6ee886f8cbfe98101fe3649', 'id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd/file', 'properties': {}}, 'image_service': } Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Trying to clone af2ad548-ec89-409b-a452-a08a7b9a73d0 from image e40ecdd6-fe4e-438b-94e3-5e48869246cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:29:08 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5583ccb9-d312-4765-bb75-e3b2e65f3358]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:08 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:08 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:09 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:09 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:09 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Temporary image e40ecdd6-fe4e-438b-94e3-5e48869246cd is fetched for user f1ed622a72154e6ba03223fc1481bf61. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7bfb9-5ea0-4699-987e-a7dd9da920c8]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:09 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:09 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:09 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:09 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:09 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:09 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2ad548-ec89-409b-a452-a08a7b9a73d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a68e2551364ce39187322b11faaee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:08Z,use_quota=True,user_id='f1ed622a72154e6ba03223fc1481bf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Creating volume af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:10 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1073741824 Sep 25 16:29:10 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:10 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1073741824" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 Sep 25 16:29:10 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:10 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0" returned: 0 in 0.258s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Attempting download of e40ecdd6-fe4e-438b-94e3-5e48869246cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}])) to volume af2ad548-ec89-409b-a452-a08a7b9a73d0. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef6901-35c1-4f28-90e8-7cf6f754639e]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb Sep 25 16:29:10 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb" returned: 0 in 0.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb Sep 25 16:29:11 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb" returned: 1 in 0.346s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e40ecdd6-fe4e-438b-94e3-5e48869246cd_2yf586yb' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2034bd-d870-4a9a-bca0-246925eef401]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:11 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:12 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD Sep 25 16:29:12 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:12 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] e40ecdd6-fe4e-438b-94e3-5e48869246cd was raw, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:12 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 Sep 25 16:29:12 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:12 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0" returned: 0 in 0.509s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e40ecdd6-fe4e-438b-94e3-5e48869246cd_3z8r5u_1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:29:12 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:29:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:12 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1G Sep 25 16:29:12 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:13 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 1G" returned: 0 in 0.365s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Downloaded image e40ecdd6-fe4e-438b-94e3-5e48869246cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}])) to volume af2ad548-ec89-409b-a452-a08a7b9a73d0 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Temporary image e40ecdd6-fe4e-438b-94e3-5e48869246cd for user f1ed622a72154e6ba03223fc1481bf61 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Marking volume af2ad548-ec89-409b-a452-a08a7b9a73d0 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Copying metadata from image e40ecdd6-fe4e-438b-94e3-5e48869246cd to af2ad548-ec89-409b-a452-a08a7b9a73d0. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Creating volume glance metadata for volume af2ad548-ec89-409b-a452-a08a7b9a73d0 backed by image e40ecdd6-fe4e-438b-94e3-5e48869246cd with: {'image_id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ef2b34677491bab4738f88afd48cbe48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92baa751-847c-46c7-9aed-e32778932617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2ad548-ec89-409b-a452-a08a7b9a73d0', 'volume_size': 1, 'image_id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef2b34677491bab4738f88afd48cbe48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22a68e2551364ce39187322b11faaee2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59b68e420a9189ff7a83996df70c81d7dd9f996c660652eb1c3f67de60ede255feefa06a99933eea3e26191c2cd6ee4e6f20cab1a6ee886f8cbfe98101fe3649', 'id': 'e40ecdd6-fe4e-438b-94e3-5e48869246cd', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e40ecdd6-fe4e-438b-94e3-5e48869246cd/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d39071-5350-4ced-ba9d-cba927020e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Volume volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 (af2ad548-ec89-409b-a452-a08a7b9a73d0): created successfully Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d39071-5350-4ced-ba9d-cba927020e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Flow 'volume_create_manager' (390fd4d5-78ee-4bf4-8fba-0b11aa29bea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1592d697-04f5-475b-8e92-80aedf8e7e32 tempest-VolumeImageDependencyTests-1743150370 None] Created volume successfully. Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Acquiring lock "cinder-af2ad548-ec89-409b-a452-a08a7b9a73d0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "cinder-af2ad548-ec89-409b-a452-a08a7b9a73d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Acquiring lock "cinder-quobyte-af2ad548-ec89-409b-a452-a08a7b9a73d0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "cinder-quobyte-af2ad548-ec89-409b-a452-a08a7b9a73d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2102e5-e57a-4b00-898c-a28fc7835953]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:14 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 Sep 25 16:29:14 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:14 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0" returned: 0 in 0.404s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0 Sep 25 16:29:15 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:15 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-af2ad548-ec89-409b-a452-a08a7b9a73d0" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "cinder-quobyte-af2ad548-ec89-409b-a452-a08a7b9a73d0" released by "delete_volume" :: held 0.732s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Created reservations ['c29322be-f2f9-428c-8c09-2e72b9408cc8', '2a0b20d7-0035-4143-9684-929ed36735c8', '5cc11fd5-f467-4ad2-953d-04fac55b923a', '075f65a8-e8c0-478c-8ca7-8b54867feb44'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:15 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:15 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.291s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Deleted volume successfully. Sep 25 16:29:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03ec9da8-b453-4fea-961c-11b3dba7491b tempest-VolumeImageDependencyTests-1743150370 None] Lock "cinder-af2ad548-ec89-409b-a452-a08a7b9a73d0-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Flow 'volume_create_manager' (00491257-471a-4ed0-8fac-9fc55ea2bbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9650145-8d02-45f3-95f2-6eb143a4f7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9650145-8d02-45f3-95f2-6eb143a4f7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104057965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d415da5-18c0-4bea-a1aa-fce827ba9ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2917fad9448ee8ff00edc8a1247a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:20Z,use_quota=True,user_id='28e3204ddcb7477e9c439572798beb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a12ea8-ce9f-45b9-954f-c5fac17993e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a12ea8-ce9f-45b9-954f-c5fac17993e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efaeb8a-c95e-4136-a577-2c97ab619217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efaeb8a-c95e-4136-a577-2c97ab619217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d415da5-18c0-4bea-a1aa-fce827ba9ce5', 'volume_name': 'volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd68422-f646-4b8f-a1ac-ff8d495a4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd68422-f646-4b8f-a1ac-ff8d495a4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0842bb-4642-4440-95b9-9d83142fb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Volume 7d415da5-18c0-4bea-a1aa-fce827ba9ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5', 'volume_size': 1} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104057965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d415da5-18c0-4bea-a1aa-fce827ba9ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2917fad9448ee8ff00edc8a1247a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:20Z,use_quota=True,user_id='28e3204ddcb7477e9c439572798beb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Creating volume 7d415da5-18c0-4bea-a1aa-fce827ba9ce5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:20 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 1073741824 Sep 25 16:29:20 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 1073741824" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 Sep 25 16:29:20 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:21 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" returned: 0 in 0.247s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0842bb-4642-4440-95b9-9d83142fb35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79cd486-0d77-4548-b095-9d9a44385567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Volume volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 (7d415da5-18c0-4bea-a1aa-fce827ba9ce5): created successfully Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79cd486-0d77-4548-b095-9d9a44385567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Flow 'volume_create_manager' (00491257-471a-4ed0-8fac-9fc55ea2bbc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-57f20b57-75e4-4df0-ae71-c751114e4897 tempest-ProjectReaderTests-1212745333 None] Created volume successfully. Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "cinder-7d415da5-18c0-4bea-a1aa-fce827ba9ce5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-7d415da5-18c0-4bea-a1aa-fce827ba9ce5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "cinder-quobyte-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-quobyte-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1043cd44-b3ab-46d8-bcb9-96448a397bb5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 Sep 25 16:29:22 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" returned: 0 in 0.374s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5 Sep 25 16:29:23 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" returned: 0 in 0.247s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-quobyte-7d415da5-18c0-4bea-a1aa-fce827ba9ce5" released by "delete_volume" :: held 0.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Created reservations ['e6d356a7-85a2-4963-879e-0ddf4ebbf35a', '53f45944-9ede-4e93-a2d1-4533ad773f21', '09df6007-d8fd-4851-b29f-d56abb38dfb0', 'f55b2960-5e3a-41dd-942f-b3cf15057bda'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:23 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.242s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Deleted volume successfully. Sep 25 16:29:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-288cea44-db40-43cd-8440-df116dc11343 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-7d415da5-18c0-4bea-a1aa-fce827ba9ce5-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Flow 'volume_create_manager' (66cf2177-e75c-405e-b45d-9f3252f7ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11607a0-70c8-4a8e-9d47-ed0ccc1e6d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11607a0-70c8-4a8e-9d47-ed0ccc1e6d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066192396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74e61e-6281-4906-aa78-9633215174c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2917fad9448ee8ff00edc8a1247a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:26Z,use_quota=True,user_id='28e3204ddcb7477e9c439572798beb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c78fa3-2c07-4bf5-bbb0-23f69a864cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c78fa3-2c07-4bf5-bbb0-23f69a864cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39609f40-857b-4e51-99e2-f5e7d46026aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39609f40-857b-4e51-99e2-f5e7d46026aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf74e61e-6281-4906-aa78-9633215174c5', 'volume_name': 'volume-bf74e61e-6281-4906-aa78-9633215174c5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cf01d0-ace9-4766-b45e-4d6e355eeb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cf01d0-ace9-4766-b45e-4d6e355eeb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287333cb-803a-4f4c-a7dc-922f4f98427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Volume bf74e61e-6281-4906-aa78-9633215174c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf74e61e-6281-4906-aa78-9633215174c5', 'volume_size': 1} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066192396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74e61e-6281-4906-aa78-9633215174c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2917fad9448ee8ff00edc8a1247a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:26Z,use_quota=True,user_id='28e3204ddcb7477e9c439572798beb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Creating volume bf74e61e-6281-4906-aa78-9633215174c5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:26 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 1073741824 Sep 25 16:29:26 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 1073741824" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 Sep 25 16:29:26 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5" returned: 0 in 0.237s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287333cb-803a-4f4c-a7dc-922f4f98427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf74e61e-6281-4906-aa78-9633215174c5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f14f8b-54c6-4917-8996-a0d0a07f3f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Volume volume-bf74e61e-6281-4906-aa78-9633215174c5 (bf74e61e-6281-4906-aa78-9633215174c5): created successfully Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f14f8b-54c6-4917-8996-a0d0a07f3f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Flow 'volume_create_manager' (66cf2177-e75c-405e-b45d-9f3252f7ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5a064809-0ad1-4536-8dc8-e1a529662d1d tempest-ProjectReaderTests-1212745333 None] Created volume successfully. Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "cinder-bf74e61e-6281-4906-aa78-9633215174c5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-bf74e61e-6281-4906-aa78-9633215174c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "cinder-quobyte-bf74e61e-6281-4906-aa78-9633215174c5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-quobyte-bf74e61e-6281-4906-aa78-9633215174c5" acquired by "delete_volume" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115d4c4-377e-4264-90f4-e5f628ad02d1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 Sep 25 16:29:27 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5" returned: 0 in 0.355s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5 Sep 25 16:29:27 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf74e61e-6281-4906-aa78-9633215174c5" returned: 0 in 0.248s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-quobyte-bf74e61e-6281-4906-aa78-9633215174c5" released by "delete_volume" :: held 0.648s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Created reservations ['39805589-f204-4489-8ef6-505cd767e6eb', 'babf5f2f-9dd6-47c1-8ad8-cfa071841946', '1f484950-cc99-4eb2-8af0-c9f10db503f5', 'a5f41e4f-5641-479d-9392-31023910a3b6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:27 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.238s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Deleted volume successfully. Sep 25 16:29:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f176f87-676d-4a8e-8018-983cc6490406 tempest-ProjectReaderTests-1212745333 None] Lock "cinder-bf74e61e-6281-4906-aa78-9633215174c5-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:37 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=25,cinder:INSERT=12,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=30,cinder:SELECT=29,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (3f12cf5e-bddd-4bd7-ab03-8b9322ebbd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546028d0-e0e1-4e31-adfd-e6f0ce5824db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546028d0-e0e1-4e31-adfd-e6f0ce5824db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2108459470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6e6729-39f7-41bb-9c3a-54753741791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:40Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ea1287-0390-4b65-8bc6-41c92d618e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ea1287-0390-4b65-8bc6-41c92d618e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa042f34-6a36-4328-a55a-2bea65acf6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa042f34-6a36-4328-a55a-2bea65acf6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6e6729-39f7-41bb-9c3a-54753741791e', 'volume_name': 'volume-ff6e6729-39f7-41bb-9c3a-54753741791e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fabe5d-8453-4cfc-8940-8c88d280b860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fabe5d-8453-4cfc-8940-8c88d280b860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44adce59-77fc-4a09-9f84-b965212b9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume ff6e6729-39f7-41bb-9c3a-54753741791e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6e6729-39f7-41bb-9c3a-54753741791e', 'volume_size': 1} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2108459470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6e6729-39f7-41bb-9c3a-54753741791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:40Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume ff6e6729-39f7-41bb-9c3a-54753741791e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:40 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e 1073741824 Sep 25 16:29:40 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e 1073741824" returned: 0 in 0.541s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:41 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e Sep 25 16:29:41 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e" returned: 0 in 0.292s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44adce59-77fc-4a09-9f84-b965212b9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6e6729-39f7-41bb-9c3a-54753741791e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2c9367-b1f2-4f82-956d-a4c21fee88e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-ff6e6729-39f7-41bb-9c3a-54753741791e (ff6e6729-39f7-41bb-9c3a-54753741791e): created successfully Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2c9367-b1f2-4f82-956d-a4c21fee88e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (3f12cf5e-bddd-4bd7-ab03-8b9322ebbd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-40c2dae5-c5ab-4494-89e4-b47f41b127d3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (5063c875-36a3-4f9b-b8f7-150be88cc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12005f7-63b1-4b9c-88d7-416ef62fe816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12005f7-63b1-4b9c-88d7-416ef62fe816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-548043767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21104537-b0cf-4c85-a07a-249e7c2f3aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:42Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3d4873-bf4f-49ad-aa20-965bc973af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3d4873-bf4f-49ad-aa20-965bc973af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3bd61-aca3-4388-b8db-01f85831184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3bd61-aca3-4388-b8db-01f85831184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21104537-b0cf-4c85-a07a-249e7c2f3aec', 'volume_name': 'volume-21104537-b0cf-4c85-a07a-249e7c2f3aec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f9486-29e3-4fe7-a5cd-996f1382ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f9486-29e3-4fe7-a5cd-996f1382ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620fad65-0f98-4b45-9d60-3ac53c18f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Volume 21104537-b0cf-4c85-a07a-249e7c2f3aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21104537-b0cf-4c85-a07a-249e7c2f3aec', 'volume_size': 1} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-548043767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21104537-b0cf-4c85-a07a-249e7c2f3aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:42Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Creating volume 21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:42 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec 1073741824 Sep 25 16:29:42 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:42 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec 1073741824" returned: 0 in 0.610s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:43 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec Sep 25 16:29:43 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (45e0315c-8106-4269-92c0-4977872de91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf27dd9d-37a8-4184-93fc-fe7bbfdff322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf27dd9d-37a8-4184-93fc-fe7bbfdff322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467440123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:43Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e6eafc-82f5-4ccc-9b50-9030001cb956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e6eafc-82f5-4ccc-9b50-9030001cb956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abda6b30-3595-41c8-9294-1ce6843b646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abda6b30-3595-41c8-9294-1ce6843b646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326', 'volume_name': 'volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea20db5d-5a08-40ef-9b38-7cdae93daca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea20db5d-5a08-40ef-9b38-7cdae93daca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30859235-ed07-4d02-ab35-2dba2ac85109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326', 'volume_size': 1} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:43 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec" returned: 0 in 0.546s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467440123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:43Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620fad65-0f98-4b45-9d60-3ac53c18f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21104537-b0cf-4c85-a07a-249e7c2f3aec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 1073741824 Sep 25 16:29:43 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19307e1f-8515-4cbc-8039-838c3b571770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Volume volume-21104537-b0cf-4c85-a07a-249e7c2f3aec (21104537-b0cf-4c85-a07a-249e7c2f3aec): created successfully Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19307e1f-8515-4cbc-8039-838c3b571770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (5063c875-36a3-4f9b-b8f7-150be88cc174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2d48ae4c-2817-4799-8e2d-afdbc17faaaa tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (b58bb6c5-c546-41cd-88f0-ec8fcb474046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7a29b4-016f-430c-a321-eb399039c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7a29b4-016f-430c-a321-eb399039c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922496385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fed1e4-6f95-490d-8de1-4e05792dcf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a7ca4-0ba3-4598-bda7-d4e34e50cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a7ca4-0ba3-4598-bda7-d4e34e50cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef09793-557d-4e7c-8609-e8531f044901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef09793-557d-4e7c-8609-e8531f044901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7fed1e4-6f95-490d-8de1-4e05792dcf68', 'volume_name': 'volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02826c3c-8287-451b-8ae7-4b15378cc6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02826c3c-8287-451b-8ae7-4b15378cc6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab824e-f90e-49ba-a404-1ab12938ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume c7fed1e4-6f95-490d-8de1-4e05792dcf68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68', 'volume_size': 1} Sep 25 16:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:44 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 1073741824" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:44 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 Sep 25 16:29:44 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Flow 'volume_create_manager' (ab5d4cc2-9910-4f63-9f04-3d1e0b126153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860a948f-c881-4c3d-92a1-2c8c7ac99e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922496385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fed1e4-6f95-490d-8de1-4e05792dcf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume c7fed1e4-6f95-490d-8de1-4e05792dcf68 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860a948f-c881-4c3d-92a1-2c8c7ac99e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f030d5-f3ea-4fbf-91aa-1dda752debee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0578796d2b4dbc91c7e594b439092a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='f8b026f6057e4d52aa82231927288746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 1073741824 Sep 25 16:29:44 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f9bd4a-bc08-433f-bfc5-5fdb63298c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f9bd4a-bc08-433f-bfc5-5fdb63298c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c3959d-d847-40ee-a391-06c2b63248b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30859235-ed07-4d02-ab35-2dba2ac85109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1f7222-e930-48ae-b165-cb06fcf7c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 (c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326): created successfully Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1f7222-e930-48ae-b165-cb06fcf7c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (45e0315c-8106-4269-92c0-4977872de91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-67e93038-dbb9-4da4-833a-c4b93c7e9bb3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (f3c59ce5-44f3-4780-b4ee-da142f372fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a50412-c53f-4d1a-abdf-5f554c95b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a50412-c53f-4d1a-abdf-5f554c95b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396562617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6436f7-6342-4c69-8b18-ed94a7e45e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d138af4-de94-408c-8ec2-f648de7ecc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d138af4-de94-408c-8ec2-f648de7ecc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f7eadc-491d-4797-8426-f9f76df03f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f7eadc-491d-4797-8426-f9f76df03f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6436f7-6342-4c69-8b18-ed94a7e45e6f', 'volume_name': 'volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5127e0c7-558e-4fff-8343-3ab858e440ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5127e0c7-558e-4fff-8343-3ab858e440ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f11dcf3-f29d-4223-9c69-bd6edc856254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume 0e6436f7-6342-4c69-8b18-ed94a7e45e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f', 'volume_size': 1} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (cbc6b1a5-e5ec-4842-9261-e5222d16e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d09390-66fe-4399-b9dc-b21c3bbfbaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d09390-66fe-4399-b9dc-b21c3bbfbaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424298598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c1518e-0fb6-49f3-b57c-3b46ebec493b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287358a3-8663-4680-b688-44b27c2af97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287358a3-8663-4680-b688-44b27c2af97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6bb9a4-b12b-44fe-ae31-158a60533734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6bb9a4-b12b-44fe-ae31-158a60533734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c1518e-0fb6-49f3-b57c-3b46ebec493b', 'volume_name': 'volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84abdef5-9571-4173-9ac6-c716f618b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84abdef5-9571-4173-9ac6-c716f618b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc23c24-5fdc-4ff6-89eb-c572650f01bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume c7c1518e-0fb6-49f3-b57c-3b46ebec493b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b', 'volume_size': 1} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c3959d-d847-40ee-a391-06c2b63248b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29f030d5-f3ea-4fbf-91aa-1dda752debee', 'volume_name': 'volume-29f030d5-f3ea-4fbf-91aa-1dda752debee', 'volume_size': 1, 'image_id': '01e15310-db70-458d-95e0-d8aee59cb816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd96c309c33039ea6876f0db0a3b53d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a0578796d2b4dbc91c7e594b439092a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc98f42490e648185615ec565477384ea0996560149a6a69136dc9866b7c61ce4d5d97090084f6c663d04f449b5eb29dcd7bc5531d3e3211ed467ddceb32f2cd', 'id': '01e15310-db70-458d-95e0-d8aee59cb816', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e15310-db70-458d-95e0-d8aee59cb816/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a448425-5079-4736-9393-66f5c0998e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a448425-5079-4736-9393-66f5c0998e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de71320-3ff3-459f-b80a-4f1fae95b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Volume 29f030d5-f3ea-4fbf-91aa-1dda752debee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29f030d5-f3ea-4fbf-91aa-1dda752debee', 'volume_size': 1, 'image_id': '01e15310-db70-458d-95e0-d8aee59cb816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd96c309c33039ea6876f0db0a3b53d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a0578796d2b4dbc91c7e594b439092a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc98f42490e648185615ec565477384ea0996560149a6a69136dc9866b7c61ce4d5d97090084f6c663d04f449b5eb29dcd7bc5531d3e3211ed467ddceb32f2cd', 'id': '01e15310-db70-458d-95e0-d8aee59cb816', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e15310-db70-458d-95e0-d8aee59cb816/file', 'properties': {}}, 'image_service': } Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Trying to clone 29f030d5-f3ea-4fbf-91aa-1dda752debee from image 01e15310-db70-458d-95e0-d8aee59cb816 at location (None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:29:45 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 1073741824" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:45 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 Sep 25 16:29:45 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (4fbfacd5-e2da-4092-a11c-fe6b5c7dc7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9cc9d7-98fd-4cf2-9fb0-228e90d2c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9cc9d7-98fd-4cf2-9fb0-228e90d2c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497388668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8286edae-1da6-4dcd-aed4-c94d0ef247f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8286edae-1da6-4dcd-aed4-c94d0ef247f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bee89cf-dd03-4b21-a9be-e6ad383fb33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bee89cf-dd03-4b21-a9be-e6ad383fb33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc', 'volume_name': 'volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46200fc4-4f96-43ee-8e9a-8478906c06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46200fc4-4f96-43ee-8e9a-8478906c06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944e184c-2941-4139-8d47-66011849c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc', 'volume_size': 1} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bb736a-6a87-49e0-bc87-35da93244ab4]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:45 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:45 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68" returned: 0 in 0.323s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396562617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6436f7-6342-4c69-8b18-ed94a7e45e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume 0e6436f7-6342-4c69-8b18-ed94a7e45e6f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f 1073741824 Sep 25 16:29:45 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab824e-f90e-49ba-a404-1ab12938ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e89de9-fe03-46a7-883f-c289f8c88dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 (c7fed1e4-6f95-490d-8de1-4e05792dcf68): created successfully Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e89de9-fe03-46a7-883f-c289f8c88dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (b58bb6c5-c546-41cd-88f0-ec8fcb474046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0432f86a-8fc1-41ab-9d58-dd5428e0f045 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Flow 'volume_create_manager' (88962743-7597-4cce-9436-32d000df3346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d0a5c-0656-435d-b2fa-98369e90d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d0a5c-0656-435d-b2fa-98369e90d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eba8da1-bc7e-49eb-8878-202fff793341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2437d83ee68d4c8f8d3dc3ee6843c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:46Z,use_quota=True,user_id='e227de9acddc481db7b2fd3821faf1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f261ec-10a0-439d-aad0-3e24ac988d0d),volume_type_id=15f261ec-10a0-439d-aad0-3e24ac988d0d)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153e4f6f-e770-4137-aff6-80971737317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153e4f6f-e770-4137-aff6-80971737317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3272a94b-2103-4f46-b8d8-b2f40cbbd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:46 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3272a94b-2103-4f46-b8d8-b2f40cbbd410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0eba8da1-bc7e-49eb-8878-202fff793341', 'volume_name': 'volume-0eba8da1-bc7e-49eb-8878-202fff793341', 'volume_size': 1, 'image_id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7954e175e61947a943b7cf2a199f9cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2437d83ee68d4c8f8d3dc3ee6843c9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0b19258cb2037b9565f948728309a1eeab0d34b632face672526e71cbfc0a490e566d69255bd187d6ea4ae82d2737e3d93cfdaa64dc77d68e3103e32547dd68', 'id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9578dff-2fe6-47d3-baca-6edd452a143b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fab427f-45bb-4f08-8984-c6a4e691d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fab427f-45bb-4f08-8984-c6a4e691d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3efce1-5384-406a-aef5-fd7f98c1194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Volume 0eba8da1-bc7e-49eb-8878-202fff793341: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0eba8da1-bc7e-49eb-8878-202fff793341', 'volume_size': 1, 'image_id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7954e175e61947a943b7cf2a199f9cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2437d83ee68d4c8f8d3dc3ee6843c9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0b19258cb2037b9565f948728309a1eeab0d34b632face672526e71cbfc0a490e566d69255bd187d6ea4ae82d2737e3d93cfdaa64dc77d68e3103e32547dd68', 'id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9578dff-2fe6-47d3-baca-6edd452a143b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Trying to clone 0eba8da1-bc7e-49eb-8878-202fff793341 from image f9578dff-2fe6-47d3-baca-6edd452a143b at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:29:46 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f 1073741824" returned: 0 in 0.577s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Temporary image 01e15310-db70-458d-95e0-d8aee59cb816 is fetched for user f8b026f6057e4d52aa82231927288746. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:29:46 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f Sep 25 16:29:46 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[643bb456-41c6-4f1b-b494-48c29fa29e52]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88f9bf-b9f9-414d-ae3c-637ce7588c02]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:46 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:46 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424298598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c1518e-0fb6-49f3-b57c-3b46ebec493b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume c7c1518e-0fb6-49f3-b57c-3b46ebec493b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:46 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b 1073741824 Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:46 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f11dcf3-f29d-4223-9c69-bd6edc856254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290559b1-ae9c-4bc9-8a0e-14dbcb0c88ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f (0e6436f7-6342-4c69-8b18-ed94a7e45e6f): created successfully Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290559b1-ae9c-4bc9-8a0e-14dbcb0c88ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (f3c59ce5-44f3-4780-b4ee-da142f372fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ae18720c-8fe8-4f18-868e-3b0b2f5cdb47 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:47 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:47 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:47 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b 1073741824" returned: 0 in 0.549s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Temporary image f9578dff-2fe6-47d3-baca-6edd452a143b is fetched for user e227de9acddc481db7b2fd3821faf1fb. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 16:29:47 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b Sep 25 16:29:47 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8363814-29d1-4754-a0c5-137b2a5ae7e8]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:47 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" returned: 0 in 0.252s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497388668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e63feabbf4fdf83b85033943c6ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:45Z,use_quota=True,user_id='1c244fbaac6449aab9418635bb0b7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Creating volume ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:47 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc23c24-5fdc-4ff6-89eb-c572650f01bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc 1073741824 Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7843901c-d7af-4cb8-8fb1-e65dd97741dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b (c7c1518e-0fb6-49f3-b57c-3b46ebec493b): created successfully Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7843901c-d7af-4cb8-8fb1-e65dd97741dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (cbc6b1a5-e5ec-4842-9261-e5222d16e205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-56387915-fce2-410d-acfc-51dcd2a74868 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:47 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:47 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:48 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc 1073741824" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc Sep 25 16:29:48 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" returned: 0 in 0.236s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.778s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944e184c-2941-4139-8d47-66011849c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7adf9-ac36-418f-9e3e-979c8d3b348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 of volume 21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Volume volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc (ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc): created successfully Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7adf9-ac36-418f-9e3e-979c8d3b348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Flow 'volume_create_manager' (4fbfacd5-e2da-4092-a11c-fe6b5c7dc7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8612d7-ff59-4a62-b47a-cf48461db40e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-684f5576-409f-426b-9632-3c2252dd26a3 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created volume successfully. Sep 25 16:29:48 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec Sep 25 16:29:48 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec" returned: 0 in 0.374s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 1G Sep 25 16:29:48 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f71351-04a0-4bf0-98c3-6e90b20d328e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc Sep 25 16:29:49 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 1G" returned: 0 in 0.462s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104537-b0cf-4c85-a07a-249e7c2f3aec -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104537-b0cf-4c85-a07a-249e7c2f3aec -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 Sep 25 16:29:49 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc Sep 25 16:29:49 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21104537-b0cf-4c85-a07a-249e7c2f3aec -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" returned: 0 in 0.324s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 is being set with open permissions: ugo+rw Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 Sep 25 16:29:49 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" returned: 0 in 0.291s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc" released by "delete_volume" :: held 0.739s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['2cf03c6a-a800-4683-90a8-3feab4c9ec33', 'efb8a404-98da-4e39-b2c2-6c80bb05cf49', 'b1ce3368-d08c-4b33-88f1-be0c13cbbc37', '33e1df50-29ec-4fd6-bb30-615490bbbc54'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:49 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:50 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info Sep 25 16:29:50 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:50 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-c7c1518e-0fb6-49f3-b57c-3b46ebec493b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c7c1518e-0fb6-49f3-b57c-3b46ebec493b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:50 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info" returned: 0 in 0.323s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info is being set with open permissions: ugo+rw Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c87289-a0bd-4682-8963-713cb1f9c07a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info Sep 25 16:29:50 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7e9a242e-fdf2-43e5-a8a4-fec27818367f tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-ebecf8f2-d0f8-437f-b5aa-cb64cf2b60cc-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:50 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b Sep 25 16:29:50 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.info" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f030d5-f3ea-4fbf-91aa-1dda752debee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0578796d2b4dbc91c7e594b439092a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='f8b026f6057e4d52aa82231927288746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Creating volume 29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1073741824 Sep 25 16:29:50 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f1457eaa-1886-4cc8-8024-a5918edeae38 tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:29:50 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b Sep 25 16:29:50 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" returned: 0 in 0.281s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c7c1518e-0fb6-49f3-b57c-3b46ebec493b" released by "delete_volume" :: held 0.731s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['2fc54c4c-2aca-45d7-86b8-e8507e67f17d', 'dc06a880-9004-4c92-9d4a-7c38bd1193a9', '0676271a-262a-4f0d-86d9-f0fdba912ed7', 'bdaff6b3-abcd-442a-a07f-920e0319909f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:51 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1073741824" returned: 0 in 0.481s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee Sep 25 16:29:51 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:51 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-0e6436f7-6342-4c69-8b18-ed94a7e45e6f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee" returned: 0 in 0.260s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.272s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eba8da1-bc7e-49eb-8878-202fff793341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2437d83ee68d4c8f8d3dc3ee6843c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:46Z,use_quota=True,user_id='e227de9acddc481db7b2fd3821faf1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f261ec-10a0-439d-aad0-3e24ac988d0d),volume_type_id=15f261ec-10a0-439d-aad0-3e24ac988d0d)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Creating volume 0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:51 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1073741824 Sep 25 16:29:51 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-0e6436f7-6342-4c69-8b18-ed94a7e45e6f-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Attempting download of 01e15310-db70-458d-95e0-d8aee59cb816 ((None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}])) to volume 29f030d5-f3ea-4fbf-91aa-1dda752debee. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ce499fd8-8c07-4ebb-861c-1ee003f20584 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c7c1518e-0fb6-49f3-b57c-3b46ebec493b-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa682e35-e3ec-4253-bdcd-a7cff4dbc952]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de9090-276d-413c-8ade-e94a14bd8b4c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs Sep 25 16:29:51 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:51 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f Sep 25 16:29:51 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 of volume 21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b8d12-ad91-49e9-a8cd-ae7d27fda699]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 Sep 25 16:29:51 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1073741824" returned: 0 in 0.611s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs Sep 25 16:29:52 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 Sep 25 16:29:52 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" returned: 0 in 0.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f Sep 25 16:29:52 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" returned: 0 in 0.396s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21104537-b0cf-4c85-a07a-249e7c2f3aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ae34d0-8467-4d09-97f5-a2a0645bddf5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs" returned: 1 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e15310-db70-458d-95e0-d8aee59cb816_lb44buqs' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b22cb-7f55-49b7-b06d-8d000e06610e]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341" returned: 0 in 0.320s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:52 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" returned: 0 in 0.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec Sep 25 16:29:52 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Attempting download of f9578dff-2fe6-47d3-baca-6edd452a143b ((None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}])) to volume 0eba8da1-bc7e-49eb-8878-202fff793341. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-0e6436f7-6342-4c69-8b18-ed94a7e45e6f" released by "delete_volume" :: held 0.913s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0160f0e-22cf-4f5a-9c5f-32fab17f4702]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:52 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['3c47b563-0c93-4052-9c8b-4a4a9938143d', '34ed2e21-7275-4e9a-b749-35031bacce38', '67d61531-1dca-4087-8c02-b659b5adbda3', 'b663229d-69f3-4a19-b93e-ed0bfdef583e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef Sep 25 16:29:52 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:52 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec" returned: 0 in 0.452s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 Sep 25 16:29:52 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD Sep 25 16:29:52 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.327s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c9484ac6-3065-42f6-850d-587d7d67f795 tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-0e6436f7-6342-4c69-8b18-ed94a7e45e6f-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:53 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef Sep 25 16:29:53 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] 01e15310-db70-458d-95e0-d8aee59cb816 was raw, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" returned: 0 in 0.429s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee Sep 25 16:29:53 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6 Sep 25 16:29:53 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef" returned: 1 in 0.360s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9578dff-2fe6-47d3-baca-6edd452a143b_kj4xzsef' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2005e9-c6b4-4a12-be68-5d2710fec5a4]: (4, 'raw') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:53 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec.e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" returned: 0 in 0.263s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6" released by "_delete_snapshot" :: held 1.703s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" released by "delete_snapshot" :: held 1.735s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Created reservations ['f0cae54d-d9fe-4568-880a-c2a177a5077b', '96ea445a-3f50-4ca0-8a3c-0d4c4d702244', 'd92d5f26-3d73-4aa4-bc63-5eea3d008d12', 'a572fa18-7811-4dd6-8793-6ab977da39e9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01593739-0ede-427d-a3f1-571ff617799a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-e65cd76c-6ae2-4857-a51b-d1ea4d1a97c6-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:53 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee" returned: 0 in 0.505s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01e15310-db70-458d-95e0-d8aee59cb816__yev4cywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:29:53 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-c7fed1e4-6f95-490d-8de1-4e05792dcf68-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1G Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c7fed1e4-6f95-490d-8de1-4e05792dcf68-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-c7fed1e4-6f95-490d-8de1-4e05792dcf68" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c7fed1e4-6f95-490d-8de1-4e05792dcf68" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD Sep 25 16:29:53 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[63990642-d6d0-4ad2-963f-5da2cb68c356]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-21104537-b0cf-4c85-a07a-249e7c2f3aec-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "cinder-21104537-b0cf-4c85-a07a-249e7c2f3aec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:54 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 Sep 25 16:29:54 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d28d8-65cc-4e17-bbd7-ec0b9ba97bbf]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee 1G" returned: 0 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Downloaded image 01e15310-db70-458d-95e0-d8aee59cb816 ((None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}])) to volume 29f030d5-f3ea-4fbf-91aa-1dda752debee successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Temporary image 01e15310-db70-458d-95e0-d8aee59cb816 for user f8b026f6057e4d52aa82231927288746 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Marking volume 29f030d5-f3ea-4fbf-91aa-1dda752debee as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Copying metadata from image 01e15310-db70-458d-95e0-d8aee59cb816 to 29f030d5-f3ea-4fbf-91aa-1dda752debee. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Creating volume glance metadata for volume 29f030d5-f3ea-4fbf-91aa-1dda752debee backed by image 01e15310-db70-458d-95e0-d8aee59cb816 with: {'image_id': '01e15310-db70-458d-95e0-d8aee59cb816', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd96c309c33039ea6876f0db0a3b53d4e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:29:54 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] f9578dff-2fe6-47d3-baca-6edd452a143b was raw, converting to qcow2 {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 Sep 25 16:29:54 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de71320-3ff3-459f-b80a-4f1fae95b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f030d5-f3ea-4fbf-91aa-1dda752debee', 'volume_size': 1, 'image_id': '01e15310-db70-458d-95e0-d8aee59cb816', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e15310-db70-458d-95e0-d8aee59cb816', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd96c309c33039ea6876f0db0a3b53d4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a0578796d2b4dbc91c7e594b439092a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc98f42490e648185615ec565477384ea0996560149a6a69136dc9866b7c61ce4d5d97090084f6c663d04f449b5eb29dcd7bc5531d3e3211ed467ddceb32f2cd', 'id': '01e15310-db70-458d-95e0-d8aee59cb816', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e15310-db70-458d-95e0-d8aee59cb816/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:54 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec Sep 25 16:29:54 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6e06ca-4da6-4871-811d-1c0900cfe5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Volume volume-29f030d5-f3ea-4fbf-91aa-1dda752debee (29f030d5-f3ea-4fbf-91aa-1dda752debee): created successfully Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6e06ca-4da6-4871-811d-1c0900cfe5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Flow 'volume_create_manager' (ab5d4cc2-9910-4f63-9f04-3d1e0b126153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-053e3e0b-f9e3-4776-947a-eeafc9baeadc tempest-VolumeImageDependencyTests-641204236 None] Created volume successfully. Sep 25 16:29:54 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68" returned: 0 in 0.458s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68 Sep 25 16:29:54 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec" returned: 0 in 0.452s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec Sep 25 16:29:54 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c7fed1e4-6f95-490d-8de1-4e05792dcf68" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c7fed1e4-6f95-490d-8de1-4e05792dcf68" released by "delete_volume" :: held 0.785s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['b9760825-3409-496c-9540-51dc182bf5b0', '16aa9fec-698f-4b78-af34-5a400a4e488d', 'ffb60692-eb89-41e7-a0e9-da1d96843f0f', '5122320e-c5cf-4e2f-ac08-ac7346210fe5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:54 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341" returned: 0 in 0.558s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9578dff-2fe6-47d3-baca-6edd452a143b_1hbe1wx0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:29:54 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1G Sep 25 16:29:54 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:54 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-21104537-b0cf-4c85-a07a-249e7c2f3aec" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-21104537-b0cf-4c85-a07a-249e7c2f3aec" released by "delete_volume" :: held 0.843s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Created reservations ['c78060ca-b470-4a8b-a792-09ae740c52e3', 'd191c02d-8f5d-49c3-b1a1-280736613eeb', '0fe77442-6b47-48f2-bfd0-0280b483a285', '6dd9dc13-daf8-4c91-9352-aa7fe400a74d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3bec2f-543a-4cfd-88ea-23298c9ef6e0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 1G" returned: 0 in 0.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Downloaded image f9578dff-2fe6-47d3-baca-6edd452a143b ((None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}])) to volume 0eba8da1-bc7e-49eb-8878-202fff793341 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Temporary image f9578dff-2fe6-47d3-baca-6edd452a143b for user e227de9acddc481db7b2fd3821faf1fb is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Marking volume 0eba8da1-bc7e-49eb-8878-202fff793341 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Copying metadata from image f9578dff-2fe6-47d3-baca-6edd452a143b to 0eba8da1-bc7e-49eb-8878-202fff793341. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Creating volume glance metadata for volume 0eba8da1-bc7e-49eb-8878-202fff793341 backed by image f9578dff-2fe6-47d3-baca-6edd452a143b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd7954e175e61947a943b7cf2a199f9cf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:29:55 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:55 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.408s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:55 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 Sep 25 16:29:55 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-963ab19c-c58f-4d9b-b434-a08056069f4b tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c7fed1e4-6f95-490d-8de1-4e05792dcf68-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Acquiring lock "cinder-29f030d5-f3ea-4fbf-91aa-1dda752debee-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3efce1-5384-406a-aef5-fd7f98c1194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eba8da1-bc7e-49eb-8878-202fff793341', 'volume_size': 1, 'image_id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9578dff-2fe6-47d3-baca-6edd452a143b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7954e175e61947a943b7cf2a199f9cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2437d83ee68d4c8f8d3dc3ee6843c9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a0b19258cb2037b9565f948728309a1eeab0d34b632face672526e71cbfc0a490e566d69255bd187d6ea4ae82d2737e3d93cfdaa64dc77d68e3103e32547dd68', 'id': 'f9578dff-2fe6-47d3-baca-6edd452a143b', 'created_at': datetime.datetime(2026, 9, 25, 14, 29, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 29, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9578dff-2fe6-47d3-baca-6edd452a143b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5c3bdc-9213-4e31-8369-0616f8a94d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "cinder-29f030d5-f3ea-4fbf-91aa-1dda752debee-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Volume volume-0eba8da1-bc7e-49eb-8878-202fff793341 (0eba8da1-bc7e-49eb-8878-202fff793341): created successfully Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5c3bdc-9213-4e31-8369-0616f8a94d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Flow 'volume_create_manager' (88962743-7597-4cce-9436-32d000df3346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-913df400-448a-44f0-a45a-0452b16be167 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Created volume successfully. Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Acquiring lock "cinder-quobyte-29f030d5-f3ea-4fbf-91aa-1dda752debee" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "cinder-quobyte-29f030d5-f3ea-4fbf-91aa-1dda752debee" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bb73a-2ce0-4762-ac1a-23ffbb3bc98a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" returned: 0 in 0.574s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.548s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:55 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326 Sep 25 16:29:55 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa65f6cf-08fb-47ca-804d-75ddecbaf2ba tempest-ProjectMemberTests-2117812452 None] Lock "cinder-21104537-b0cf-4c85-a07a-249e7c2f3aec-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Acquiring lock "cinder-0eba8da1-bc7e-49eb-8878-202fff793341-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "cinder-0eba8da1-bc7e-49eb-8878-202fff793341-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee Sep 25 16:29:55 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Acquiring lock "cinder-quobyte-0eba8da1-bc7e-49eb-8878-202fff793341" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "cinder-quobyte-0eba8da1-bc7e-49eb-8878-202fff793341" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[64867de8-7762-49d3-87f7-cc326ce914ec]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (61dc3803-4f55-4f7c-ac78-9627b74e6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6075f7-034a-4d73-a2c0-2af055c3d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6075f7-034a-4d73-a2c0-2af055c3d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878172986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42a9701-b348-43c2-a1d8-5badd891c451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:56Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84556493-f3ea-4711-acb4-64d1f4881874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:55 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84556493-f3ea-4711-acb4-64d1f4881874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ff1e17-c27c-4b58-b6a9-69b3d9aa9c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ff1e17-c27c-4b58-b6a9-69b3d9aa9c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42a9701-b348-43c2-a1d8-5badd891c451', 'volume_name': 'volume-f42a9701-b348-43c2-a1d8-5badd891c451', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a87317-df7b-416b-a794-2ea9ba300be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a87317-df7b-416b-a794-2ea9ba300be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4efbbe5-0c7c-4cc6-a54c-832b7eb1499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Volume f42a9701-b348-43c2-a1d8-5badd891c451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42a9701-b348-43c2-a1d8-5badd891c451', 'volume_size': 1} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878172986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42a9701-b348-43c2-a1d8-5badd891c451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:56Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Creating volume f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:56 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 Sep 25 16:29:56 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" returned: 0 in 0.415s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 1073741824 Sep 25 16:29:56 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326" released by "delete_volume" :: held 1.058s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['957b176f-66b0-467f-ab80-cc272fbfa51c', 'e9312523-06a3-4a2f-80bb-3a5d22e55334', '98b9d0e1-6428-4aa0-a8ce-44ee0c558ae0', '9de7430e-d93a-40c1-802e-7d72eb4309f1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:56 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee" returned: 0 in 0.604s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee Sep 25 16:29:56 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:56 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341" returned: 0 in 0.470s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341 Sep 25 16:29:56 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-29f030d5-f3ea-4fbf-91aa-1dda752debee" returned: 0 in 0.310s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "cinder-quobyte-29f030d5-f3ea-4fbf-91aa-1dda752debee" released by "delete_volume" :: held 0.974s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Created reservations ['b9f0a43d-a745-4da5-8190-454fad02f25a', '169dae85-72bf-4b4b-a1da-a60625213d79', 'a5f66c88-94c6-4fde-bd26-dfe81b5f56c4', '398b8ea3-2bbf-4937-ae25-2263cda5b9b2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:56 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:56 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 1073741824" returned: 0 in 0.609s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b78b327a-99d1-4dca-ba33-5ea91a10bd3a tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-c5a5a9da-c540-4b93-ab9c-e9cb9a2ce326-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:56 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-0eba8da1-bc7e-49eb-8878-202fff793341" returned: 0 in 0.307s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "cinder-quobyte-0eba8da1-bc7e-49eb-8878-202fff793341" released by "delete_volume" :: held 0.851s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:56 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:56 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 Sep 25 16:29:56 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Created reservations ['30f18b8b-da5a-4451-b766-b03579b43033', '1ace14f1-7ae4-4966-ac6c-f3b190d91430', '447b7b77-f0e9-4c95-86d3-c5b008a0735b', '13de0dbd-7f33-4601-93e7-930503698a49'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:56 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:57 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Deleted volume successfully. Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd6a1cbe-b776-4f70-b68e-21e4f3314264 tempest-VolumeImageDependencyTests-641204236 None] Lock "cinder-29f030d5-f3ea-4fbf-91aa-1dda752debee-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:57 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4efbbe5-0c7c-4cc6-a54c-832b7eb1499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42a9701-b348-43c2-a1d8-5badd891c451', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad5bfa5-9e1d-492c-b5db-d53df4b8da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Volume volume-f42a9701-b348-43c2-a1d8-5badd891c451 (f42a9701-b348-43c2-a1d8-5badd891c451): created successfully Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad5bfa5-9e1d-492c-b5db-d53df4b8da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (61dc3803-4f55-4f7c-ac78-9627b74e6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d7b471c5-c668-4875-a9b0-e2e211764d00 tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-ff6e6729-39f7-41bb-9c3a-54753741791e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-ff6e6729-39f7-41bb-9c3a-54753741791e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "cinder-quobyte-ff6e6729-39f7-41bb-9c3a-54753741791e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:57 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-ff6e6729-39f7-41bb-9c3a-54753741791e" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Deleted volume successfully. Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cd13eb8-dfc1-496a-a57c-564f3e72b9a3 tempest-VolumeAndVolumeTypeFromImageTest-331430094 None] Lock "cinder-0eba8da1-bc7e-49eb-8878-202fff793341-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb61628-6fe7-4f74-bf7a-fbfd58017a78]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:57 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e Sep 25 16:29:57 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:57 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e" returned: 0 in 0.417s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:57 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e Sep 25 16:29:57 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-ff6e6729-39f7-41bb-9c3a-54753741791e" returned: 0 in 0.291s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-quobyte-ff6e6729-39f7-41bb-9c3a-54753741791e" released by "delete_volume" :: held 0.781s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Created reservations ['326f45d2-c1d1-43c3-acd5-a7398611dbcf', '03b3e7b2-3b0e-4cbd-a6c0-7eb65cee5e74', 'a200f8c4-1f4b-4ece-a88d-6ddadb23bdbe', '86accd6f-69b0-4c0c-af0e-4e41ff711940'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:58 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:29:58 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot 2ce7cfd2-eeed-48bf-943f-e9a624391b2a of volume f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6901c5-c0c5-4401-8cb6-dd319b2d1a9a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 Sep 25 16:29:58 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.347s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Deleted volume successfully. Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1721f216-3ac0-4ac6-9c6f-eddc5853ae5d tempest-CreateVolumesFromSourceVolumeTest-151821399 None] Lock "cinder-ff6e6729-39f7-41bb-9c3a-54753741791e-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:58 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451" returned: 0 in 0.509s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a 1G Sep 25 16:29:58 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:59 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a 1G" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42a9701-b348-43c2-a1d8-5badd891c451 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:59 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42a9701-b348-43c2-a1d8-5badd891c451 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a Sep 25 16:29:59 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:59 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42a9701-b348-43c2-a1d8-5badd891c451 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a" returned: 0 in 0.317s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:59 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a is being set with open permissions: ugo+rw Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:59 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a Sep 25 16:29:59 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:59 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a" returned: 0 in 0.286s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info Sep 25 16:30:00 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info" returned: 0 in 0.346s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info is being set with open permissions: ugo+rw Sep 25 16:30:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info Sep 25 16:30:00 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.info" returned: 0 in 0.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-61b57543-b537-48be-9caa-cecdd599ae9a tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-2ce7cfd2-eeed-48bf-943f-e9a624391b2a-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-2ce7cfd2-eeed-48bf-943f-e9a624391b2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-2ce7cfd2-eeed-48bf-943f-e9a624391b2a" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-2ce7cfd2-eeed-48bf-943f-e9a624391b2a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot 2ce7cfd2-eeed-48bf-943f-e9a624391b2a of volume f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[30acf822-1839-4550-a46e-5847c64adff8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:01 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a Sep 25 16:30:01 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a" returned: 0 in 0.457s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f42a9701-b348-43c2-a1d8-5badd891c451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e77ad-6b40-4021-8598-b45bf927c4ee]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:02 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 Sep 25 16:30:02 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:02 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451" returned: 0 in 0.441s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:02 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a Sep 25 16:30:02 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:02 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a" returned: 0 in 0.536s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:02 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a Sep 25 16:30:02 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Flow 'volume_create_manager' (6a9c1d46-18c1-4015-ba45-3b1067f2d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3afc3a-16ea-419d-b715-509b3cfb88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3afc3a-16ea-419d-b715-509b3cfb88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515285852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2842323d-4fdd-4d93-9c8f-16e6449b3868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2fad61c282430c82f1b770ab8d5a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:03Z,use_quota=True,user_id='f7241d7bcef64d7cbbf9c0d7f92b63e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0f4bb3-cc2f-46cf-bfaa-f1e5af3f9312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0f4bb3-cc2f-46cf-bfaa-f1e5af3f9312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bbb559-66bd-4fc6-95d4-d65f129a7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bbb559-66bd-4fc6-95d4-d65f129a7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2842323d-4fdd-4d93-9c8f-16e6449b3868', 'volume_name': 'volume-2842323d-4fdd-4d93-9c8f-16e6449b3868', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37680e5a-da8c-4380-8357-6caf7e2c8d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37680e5a-da8c-4380-8357-6caf7e2c8d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2ed8eb-6a84-4db8-a646-3929ec1db624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Volume 2842323d-4fdd-4d93-9c8f-16e6449b3868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2842323d-4fdd-4d93-9c8f-16e6449b3868', 'volume_size': 1} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515285852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2842323d-4fdd-4d93-9c8f-16e6449b3868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2fad61c282430c82f1b770ab8d5a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:03Z,use_quota=True,user_id='f7241d7bcef64d7cbbf9c0d7f92b63e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Creating volume 2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-573d1be2-a1fe-465c-bbac-8fd0d897960e tempest-ProjectAdminTests-220802695 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:30:03 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 1073741824 Sep 25 16:30:03 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:03 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451.2ce7cfd2-eeed-48bf-943f-e9a624391b2a" returned: 0 in 0.324s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-2ce7cfd2-eeed-48bf-943f-e9a624391b2a" released by "_delete_snapshot" :: held 1.909s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" released by "delete_snapshot" :: held 1.942s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Created reservations ['db48dc38-e6f2-43d0-a7a8-075ded8b7c1c', '0e0a849e-f168-4cc2-a2c8-12b79b61a711', '5361691f-3a63-4c78-8272-c8275f1773be', 'ad4b7d03-6d1e-4b47-af4c-a4a893254e64'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-781e64b4-a9bb-47b4-94d1-0b333c15c989 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-2ce7cfd2-eeed-48bf-943f-e9a624391b2a-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:03 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (6adbb877-1f1d-4dd3-a7c9-b2ec929c45d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f51e54c-5122-4717-998b-4c255f9ba1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 1073741824" returned: 0 in 0.669s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f51e54c-5122-4717-998b-4c255f9ba1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850783342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2baeac-cd7d-4899-90a4-08a33581bed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:04Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faad5ff-ef5c-4dc3-a94a-11dab801bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faad5ff-ef5c-4dc3-a94a-11dab801bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8e4c2-33cc-465a-8d31-662c509f13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8e4c2-33cc-465a-8d31-662c509f13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2baeac-cd7d-4899-90a4-08a33581bed4', 'volume_name': 'volume-8f2baeac-cd7d-4899-90a4-08a33581bed4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d590d47c-77e5-417c-8c71-6716034d6896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d590d47c-77e5-417c-8c71-6716034d6896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c81ccf-bbf4-4c34-a310-496a291aea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Volume 8f2baeac-cd7d-4899-90a4-08a33581bed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2baeac-cd7d-4899-90a4-08a33581bed4', 'volume_size': 1} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:03 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (dc6a3982-6c18-4322-8ce0-9f3bc46bc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916149e4-17a6-4b72-a4d5-e0c78667fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.368s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850783342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2baeac-cd7d-4899-90a4-08a33581bed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:04Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Creating volume 8f2baeac-cd7d-4899-90a4-08a33581bed4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916149e4-17a6-4b72-a4d5-e0c78667fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463531165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ae35be-ec9b-436a-ba4e-64fcf2027762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:04Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e29b3-cdd3-44a5-b415-c7f8a73ddb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e29b3-cdd3-44a5-b415-c7f8a73ddb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 1073741824 Sep 25 16:30:04 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0b83ce-71e1-4dc3-8bf7-93b4a575e56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0b83ce-71e1-4dc3-8bf7-93b4a575e56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ae35be-ec9b-436a-ba4e-64fcf2027762', 'volume_name': 'volume-05ae35be-ec9b-436a-ba4e-64fcf2027762', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ea7a33-2931-43ef-a37e-a29ec62cbbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ea7a33-2931-43ef-a37e-a29ec62cbbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496db2b7-619e-49a2-bc2e-7f432e66f1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Volume 05ae35be-ec9b-436a-ba4e-64fcf2027762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ae35be-ec9b-436a-ba4e-64fcf2027762', 'volume_size': 1} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2ed8eb-6a84-4db8-a646-3929ec1db624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2842323d-4fdd-4d93-9c8f-16e6449b3868', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf78432-b592-46a3-a7bd-99f9d7150417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Volume volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 (2842323d-4fdd-4d93-9c8f-16e6449b3868): created successfully Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf78432-b592-46a3-a7bd-99f9d7150417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Flow 'volume_create_manager' (6a9c1d46-18c1-4015-ba45-3b1067f2d17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1c01687f-25e4-4336-b41f-5e1a1606b94e tempest-VolumeDependencyTests-1198813550 None] Created volume successfully. Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (60f1ea57-3174-41be-8f4f-cd956f319805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925f00a7-4f6c-44fe-835c-c9ba198e44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-f42a9701-b348-43c2-a1d8-5badd891c451-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925f00a7-4f6c-44fe-835c-c9ba198e44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432615102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b3f46-3fb1-43b5-b6de-5f7bd32038a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:05Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9edd7bc3-886d-497b-a509-e6b2a5125c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9edd7bc3-886d-497b-a509-e6b2a5125c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018b11c2-ea8a-4763-a847-5d84f41bf83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018b11c2-ea8a-4763-a847-5d84f41bf83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016b3f46-3fb1-43b5-b6de-5f7bd32038a4', 'volume_name': 'volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac6194a-2352-499b-b176-e614404034d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac6194a-2352-499b-b176-e614404034d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c11470-265b-4275-833b-6830d28abf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Volume 016b3f46-3fb1-43b5-b6de-5f7bd32038a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4', 'volume_size': 1} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-f42a9701-b348-43c2-a1d8-5badd891c451-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9cc58e-7710-4d86-bf4d-7a2fcbaa1f5e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 1073741824" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 Sep 25 16:30:05 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 Sep 25 16:30:05 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463531165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ae35be-ec9b-436a-ba4e-64fcf2027762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:04Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Creating volume 05ae35be-ec9b-436a-ba4e-64fcf2027762 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:05 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 1073741824 Sep 25 16:30:05 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451" returned: 0 in 0.598s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c81ccf-bbf4-4c34-a310-496a291aea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2baeac-cd7d-4899-90a4-08a33581bed4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b388c-ec3e-4b71-a7d6-a07525ac79dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Volume volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 (8f2baeac-cd7d-4899-90a4-08a33581bed4): created successfully Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b388c-ec3e-4b71-a7d6-a07525ac79dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:05 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451 Sep 25 16:30:05 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (6adbb877-1f1d-4dd3-a7c9-b2ec929c45d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (a0cdce8f-531c-4591-a461-b1e6c409e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2fbdf-8377-4c8b-9802-08dbe5b3549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-84e69e05-7015-4dbc-972e-42d1e8e5f0a6 tempest-CreateVolumesFromImageTest-538214320 None] Created volume successfully. Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2fbdf-8377-4c8b-9802-08dbe5b3549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1518843812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef7c767-a67f-4c76-8a9f-9f77190d9a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:05Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab4d7b-f556-4cc6-bb53-353b9d730e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab4d7b-f556-4cc6-bb53-353b9d730e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0bafc0-8be6-455d-8a9b-6241327d5900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0bafc0-8be6-455d-8a9b-6241327d5900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef7c767-a67f-4c76-8a9f-9f77190d9a8c', 'volume_name': 'volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30aed72f-2a97-4eb0-8978-6401b3211f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30aed72f-2a97-4eb0-8978-6401b3211f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb082aee-8e4e-42a5-bf27-b4235c97f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Volume 3ef7c767-a67f-4c76-8a9f-9f77190d9a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c', 'volume_size': 1} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (2a36e051-b29a-4c06-b0c4-d73e96e57320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb4d9e-4bd2-4494-bb3b-2465f7a6cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb4d9e-4bd2-4494-bb3b-2465f7a6cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482535584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d7d339-8c58-467b-8b1a-19f0037060e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:06Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b64157-3566-4245-afd4-d126233c3fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b64157-3566-4245-afd4-d126233c3fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f64e8a-7030-4149-8e48-148c1edad277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f64e8a-7030-4149-8e48-148c1edad277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d7d339-8c58-467b-8b1a-19f0037060e8', 'volume_name': 'volume-05d7d339-8c58-467b-8b1a-19f0037060e8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a360f632-d351-427a-a4e7-ca34504c7d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a360f632-d351-427a-a4e7-ca34504c7d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a2203-b497-49de-879c-6532f22c512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Volume 05d7d339-8c58-467b-8b1a-19f0037060e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d7d339-8c58-467b-8b1a-19f0037060e8', 'volume_size': 1} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f42a9701-b348-43c2-a1d8-5badd891c451" returned: 0 in 0.463s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:06 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-f42a9701-b348-43c2-a1d8-5badd891c451" released by "delete_volume" :: held 1.217s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:06 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 1073741824" returned: 0 in 0.636s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Created reservations ['38140326-ae1b-45cf-9c78-e2ea4006ea58', 'ba3193f9-09bf-4634-8ab1-7889672a98f9', 'c2debc8d-a9bc-4953-8376-55aca436276c', '0e7c0dee-6d64-48ee-90a9-d3bdb1de04b9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:06 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 Sep 25 16:30:06 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:06 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:30:06 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432615102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b3f46-3fb1-43b5-b6de-5f7bd32038a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:05Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Creating volume 016b3f46-3fb1-43b5-b6de-5f7bd32038a4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496db2b7-619e-49a2-bc2e-7f432e66f1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ae35be-ec9b-436a-ba4e-64fcf2027762', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 1073741824 Sep 25 16:30:06 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19440b72-113b-4597-ad21-0a2ec49588cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Volume volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 (05ae35be-ec9b-436a-ba4e-64fcf2027762): created successfully Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19440b72-113b-4597-ad21-0a2ec49588cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (dc6a3982-6c18-4322-8ce0-9f3bc46bc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6bdf420d-320a-4f19-9e0e-9e28637757df tempest-CreateVolumesFromImageTest-538214320 None] Created volume successfully. Sep 25 16:30:06 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:30:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381cc7f8-eb3b-40df-a115-064124c9f611 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-f42a9701-b348-43c2-a1d8-5badd891c451-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:07 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 1073741824" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 Sep 25 16:30:07 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.674s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c11470-265b-4275-833b-6830d28abf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece3a8bd-4ae2-4512-b301-318cedc1e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Creating offline snapshot 16979a06-9e5f-4426-b73d-9570f3faefa2 of volume 2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Volume volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 (016b3f46-3fb1-43b5-b6de-5f7bd32038a4): created successfully Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece3a8bd-4ae2-4512-b301-318cedc1e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (60f1ea57-3174-41be-8f4f-cd956f319805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce79909f-3212-44dd-bb13-a072db88e10c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d8cea1c9-2a17-4ba8-9fd2-1bb188260beb tempest-CreateVolumesFromImageTest-538214320 None] Created volume successfully. Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (4694f56d-33c9-4213-8b50-7f69d0a933bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd20004-e4a9-434e-9eae-31b34734d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd20004-e4a9-434e-9eae-31b34734d577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249799526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19878cb2-9ae6-4ead-9eca-4115028c28f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:08Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140824b-4a71-4d53-bcb4-0ed70d54a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140824b-4a71-4d53-bcb4-0ed70d54a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dca14f-6a9b-46d9-b96e-b56aa09cbbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dca14f-6a9b-46d9-b96e-b56aa09cbbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19878cb2-9ae6-4ead-9eca-4115028c28f1', 'volume_name': 'volume-19878cb2-9ae6-4ead-9eca-4115028c28f1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc6601f-adfe-4535-b76c-86353e92550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc6601f-adfe-4535-b76c-86353e92550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:07 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348ffeac-c223-4e2f-90bc-53cf275771e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Volume 19878cb2-9ae6-4ead-9eca-4115028c28f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19878cb2-9ae6-4ead-9eca-4115028c28f1', 'volume_size': 1} Sep 25 16:30:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:07 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.454s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:08 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 1G Sep 25 16:30:08 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:08 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 1G" returned: 0 in 0.494s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:08 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:08 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:08 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.300s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:08 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 is being set with open permissions: ugo+rw Sep 25 16:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:08 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:08 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.241s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info Sep 25 16:30:09 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info" returned: 0 in 0.264s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info is being set with open permissions: ugo+rw Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info Sep 25 16:30:09 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.info" returned: 0 in 0.277s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1518843812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef7c767-a67f-4c76-8a9f-9f77190d9a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:05Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Creating volume 3ef7c767-a67f-4c76-8a9f-9f77190d9a8c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c 1073741824 Sep 25 16:30:09 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4a3cf49f-5a82-4c72-a615-53d374ad7194 tempest-VolumeDependencyTests-1198813550 None] Create snapshot completed successfully Sep 25 16:30:10 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c 1073741824" returned: 0 in 0.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:10 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c Sep 25 16:30:10 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:10 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" returned: 0 in 0.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.319s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482535584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d7d339-8c58-467b-8b1a-19f0037060e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b593f6f734b24a819a68c27147b355f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:06Z,use_quota=True,user_id='85ab21f4c50445138599dfb5c4816734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Creating volume 05d7d339-8c58-467b-8b1a-19f0037060e8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:10 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb082aee-8e4e-42a5-bf27-b4235c97f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58043853-8cb9-4dad-b7b8-da5ac716cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:10 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 1073741824 Sep 25 16:30:10 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Volume volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c (3ef7c767-a67f-4c76-8a9f-9f77190d9a8c): created successfully Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58043853-8cb9-4dad-b7b8-da5ac716cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (a0cdce8f-531c-4591-a461-b1e6c409e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-688166bc-55ae-4848-8060-a00d43328369 tempest-CreateVolumesFromImageTest-538214320 None] Created volume successfully. Sep 25 16:30:11 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 1073741824" returned: 0 in 0.545s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:11 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 Sep 25 16:30:11 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:11 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.697s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249799526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19878cb2-9ae6-4ead-9eca-4115028c28f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:08Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Creating volume 19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a2203-b497-49de-879c-6532f22c512f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d7d339-8c58-467b-8b1a-19f0037060e8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71e7f08-894d-4c4a-8551-ef79b9022f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 1073741824 Sep 25 16:30:11 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Flow 'volume_create_manager' (4447126b-4dc3-494e-bc5a-cbd115c71257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc10d614-9546-46c6-bb25-452f38e51d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc10d614-9546-46c6-bb25-452f38e51d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-452927953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28de443c-dea9-428c-8b0f-58eff8f7ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2fad61c282430c82f1b770ab8d5a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16979a06-9e5f-4426-b73d-9570f3faefa2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:11Z,use_quota=True,user_id='f7241d7bcef64d7cbbf9c0d7f92b63e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4990f0-43b5-44d8-85ce-ffbdb2ffc209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4990f0-43b5-44d8-85ce-ffbdb2ffc209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa823ff-c712-4980-b776-9dc852c5b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa823ff-c712-4980-b776-9dc852c5b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28de443c-dea9-428c-8b0f-58eff8f7ee51', 'volume_name': 'volume-28de443c-dea9-428c-8b0f-58eff8f7ee51', 'volume_size': 1, 'snapshot_id': '16979a06-9e5f-4426-b73d-9570f3faefa2'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e875e-e0cc-48f3-90be-e58e1d372523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477e875e-e0cc-48f3-90be-e58e1d372523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae8be3b-9ffc-4000-ab34-c6cfb358c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Volume 28de443c-dea9-428c-8b0f-58eff8f7ee51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28de443c-dea9-428c-8b0f-58eff8f7ee51', 'volume_size': 1, 'snapshot_id': '16979a06-9e5f-4426-b73d-9570f3faefa2'} Sep 25 16:30:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Volume volume-05d7d339-8c58-467b-8b1a-19f0037060e8 (05d7d339-8c58-467b-8b1a-19f0037060e8): created successfully Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71e7f08-894d-4c4a-8551-ef79b9022f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Flow 'volume_create_manager' (2a36e051-b29a-4c06-b0c4-d73e96e57320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4b460cf2-e018-48bf-984b-5516375920ae tempest-CreateVolumesFromImageTest-538214320 None] Created volume successfully. Sep 25 16:30:11 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 1073741824" returned: 0 in 0.481s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:11 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 Sep 25 16:30:11 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:12 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1" returned: 0 in 0.268s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.636s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2-28de443c-dea9-428c-8b0f-58eff8f7ee51" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348ffeac-c223-4e2f-90bc-53cf275771e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19878cb2-9ae6-4ead-9eca-4115028c28f1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0a3b98-9034-4236-8a54-f83b9483724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2-28de443c-dea9-428c-8b0f-58eff8f7ee51" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Creating volume 28de443c-dea9-428c-8b0f-58eff8f7ee51 from snapshot 16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Volume volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 (19878cb2-9ae6-4ead-9eca-4115028c28f1): created successfully Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0a3b98-9034-4236-8a54-f83b9483724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (4694f56d-33c9-4213-8b50-7f69d0a933bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] snapshot: 16979a06-9e5f-4426-b73d-9570f3faefa2, volume: 28de443c-dea9-428c-8b0f-58eff8f7ee51, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:30:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-52c6a4c7-5314-44d3-b808-37e1a05cccda tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8592e84-5de1-4e77-9c07-f7743b5a9a2d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:12 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:12 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-05d7d339-8c58-467b-8b1a-19f0037060e8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-05d7d339-8c58-467b-8b1a-19f0037060e8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-quobyte-05d7d339-8c58-467b-8b1a-19f0037060e8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-05d7d339-8c58-467b-8b1a-19f0037060e8" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[763fcb69-2205-4c7d-be9f-371f375a5f6c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:12 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.448s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2842323d-4fdd-4d93-9c8f-16e6449b3868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:12 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 Sep 25 16:30:12 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088f743-3269-4f24-a34b-7fdd949604f0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:12 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:12 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:13 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8" returned: 0 in 0.544s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8 Sep 25 16:30:13 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:13 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.508s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 Sep 25 16:30:13 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:13 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05d7d339-8c58-467b-8b1a-19f0037060e8" returned: 0 in 0.301s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-05d7d339-8c58-467b-8b1a-19f0037060e8" released by "delete_volume" :: held 0.899s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Created reservations ['f0408931-9cc4-41d6-8898-966d2b290c20', 'efa507f9-be4c-4433-a2d5-97bc5ff6d6fd', '61d617ee-c7d7-4f73-ad3b-c1c6fbb3d41e', '3e2a1612-ecfc-4a9b-aa38-78be72ad829f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:13 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:14 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Deleted volume successfully. Sep 25 16:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-064269a7-f188-4fd4-9779-f52723a62c7a tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-05d7d339-8c58-467b-8b1a-19f0037060e8-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-quobyte-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caaa80d-538a-483c-86a7-4aabbf194eaa]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:15 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c Sep 25 16:30:15 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:16 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" returned: 0 in 0.952s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:16 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c Sep 25 16:30:16 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:16 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" returned: 0 in 0.538s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c" released by "delete_volume" :: held 1.591s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Created reservations ['b8f29d10-8360-468d-8e58-518ce7fe85a7', '5e72d145-10e8-4612-939a-304d872c5fc5', '22fefb01-6fda-4971-a537-018dd5b0b290', '7493265c-5a7f-43f7-b9a7-55603b82e2c9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:17 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:17 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-016b3f46-3fb1-43b5-b6de-5f7bd32038a4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-016b3f46-3fb1-43b5-b6de-5f7bd32038a4-delete_volume" acquired by "delete_volume" :: waited 0.211s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:17 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.585s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Deleted volume successfully. Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-quobyte-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78e5fcff-d888-4a89-a212-40a314f77d52 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-3ef7c767-a67f-4c76-8a9f-9f77190d9a8c-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[786988b1-439f-4497-ba19-882eb196c9c5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:17 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 Sep 25 16:30:17 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:18 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" returned: 0 in 0.743s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:18 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4 Sep 25 16:30:18 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:18 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" returned: 0 in 0.516s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-016b3f46-3fb1-43b5-b6de-5f7bd32038a4" released by "delete_volume" :: held 1.377s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Created reservations ['16573f0e-1312-4563-9dbf-a42b55254343', '56cc716e-4cee-4680-9276-f20a57adcd6f', 'd2be83bc-dd68-41ba-a20d-1f355612268a', 'cf2a321a-ce99-4e73-bfd6-ef6621cbe1cc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:19 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:19 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:19 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.456s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Deleted volume successfully. Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c98edda2-ee1f-4513-b771-b46c1618bb34 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-016b3f46-3fb1-43b5-b6de-5f7bd32038a4-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-05ae35be-ec9b-436a-ba4e-64fcf2027762-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-05ae35be-ec9b-436a-ba4e-64fcf2027762-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-quobyte-05ae35be-ec9b-436a-ba4e-64fcf2027762" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-05ae35be-ec9b-436a-ba4e-64fcf2027762" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[963951dc-9c0a-424b-addf-8fa4f4275831]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:20 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 Sep 25 16:30:20 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:20 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:20 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762 Sep 25 16:30:20 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:20 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51" returned: 0 in 7.656s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:30:21 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Converted 1024.00 MB image at 133.73 MB/s Sep 25 16:30:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 is being set with open permissions: ugo+rw Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:21 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 Sep 25 16:30:21 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:21 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-05ae35be-ec9b-436a-ba4e-64fcf2027762" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-05ae35be-ec9b-436a-ba4e-64fcf2027762" released by "delete_volume" :: held 1.103s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Created reservations ['d62d06f5-3de8-4fdd-bba8-7637da6249f2', '86292796-5c7d-49b8-a583-9721db8dd164', 'c61dde76-2fde-4cca-ae73-dd34af709f86', '2c39bfef-d0d7-4777-a219-b8523c562c4b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:21 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:21 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:21 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" released by "_copy_volume_from_snapshot" :: held 9.019s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2-28de443c-dea9-428c-8b0f-58eff8f7ee51" released by "_create_volume_from_snapshot" :: held 9.125s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.157s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.262s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot eb45bf91-2be6-48c3-ac8a-da7096482745 of volume 19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae8be3b-9ffc-4000-ab34-c6cfb358c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28de443c-dea9-428c-8b0f-58eff8f7ee51', 'volume_size': 1, 'snapshot_id': '16979a06-9e5f-4426-b73d-9570f3faefa2'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabb829f-0079-4958-9eaa-0bdd01417e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8966c0df-9d20-40cb-84b1-1465cf2da127]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Volume volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 (28de443c-dea9-428c-8b0f-58eff8f7ee51): created successfully Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabb829f-0079-4958-9eaa-0bdd01417e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Flow 'volume_create_manager' (4447126b-4dc3-494e-bc5a-cbd115c71257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ace13d00-a135-4676-87a9-acba2e7b3a7c tempest-VolumeDependencyTests-1198813550 None] Created volume successfully. Sep 25 16:30:21 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.269s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Deleted volume successfully. Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c2f41ba-ff69-48d2-8883-6353f71ace35 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-05ae35be-ec9b-436a-ba4e-64fcf2027762-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:21 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 Sep 25 16:30:21 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:21 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1" returned: 0 in 0.452s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:21 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 1G Sep 25 16:30:21 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-8f2baeac-cd7d-4899-90a4-08a33581bed4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-8f2baeac-cd7d-4899-90a4-08a33581bed4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "cinder-quobyte-8f2baeac-cd7d-4899-90a4-08a33581bed4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-8f2baeac-cd7d-4899-90a4-08a33581bed4" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aea854-a5f0-45dd-b297-29ee9e557300]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-16979a06-9e5f-4426-b73d-9570f3faefa2-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:22 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 Sep 25 16:30:22 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-16979a06-9e5f-4426-b73d-9570f3faefa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:22 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 1G" returned: 0 in 0.560s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:22 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 Sep 25 16:30:22 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Deleting offline snapshot 16979a06-9e5f-4426-b73d-9570f3faefa2 of volume 2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] snapshot_file for this snap is: volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d962f12-e2c6-40b2-8ac2-2e3a78fc1ead]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:22 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4" returned: 0 in 0.513s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4 Sep 25 16:30:22 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745" returned: 0 in 0.401s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 is being set with open permissions: ugo+rw Sep 25 16:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 Sep 25 16:30:22 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.498s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2842323d-4fdd-4d93-9c8f-16e6449b3868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[569ce837-6495-47a1-857e-42b25cccfcd0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8f2baeac-cd7d-4899-90a4-08a33581bed4" returned: 0 in 0.327s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-quobyte-8f2baeac-cd7d-4899-90a4-08a33581bed4" released by "delete_volume" :: held 0.893s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:23 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:23 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info Sep 25 16:30:23 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Created reservations ['10370a82-0676-4416-8d89-a799b86546d6', 'af2a8f20-da7d-4eb3-8023-dce46401147d', 'f49da923-54f7-4c06-ac4f-10ac72a2eb2e', '19f3295a-e2b2-4598-875e-6efff476fce5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:23 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info" returned: 0 in 0.489s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info is being set with open permissions: ugo+rw Sep 25 16:30:23 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.355s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Deleted volume successfully. Sep 25 16:30:23 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info Sep 25 16:30:23 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b62fca19-a934-447d-ac23-93890ef1b0d8 tempest-CreateVolumesFromImageTest-538214320 None] Lock "cinder-8f2baeac-cd7d-4899-90a4-08a33581bed4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:23 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:23 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.info" returned: 0 in 0.392s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9b73abaa-4321-484d-9408-f8d90c418a12 tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:30:24 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.441s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:24 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2 Sep 25 16:30:24 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868.16979a06-9e5f-4426-b73d-9570f3faefa2" returned: 0 in 0.286s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-16979a06-9e5f-4426-b73d-9570f3faefa2" released by "_delete_snapshot" :: held 2.222s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" released by "delete_snapshot" :: held 2.260s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-eb45bf91-2be6-48c3-ac8a-da7096482745-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Created reservations ['8a4b9c64-b2b1-43ad-ab87-b0116ea4933b', '60fe99f4-f9fd-4995-88f7-9cf6501615a5', '64aeeae7-e3de-4437-b307-9e1a182e9e50', '6ec76bf7-6e7d-43f3-b2c0-6909355cd183'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-eb45bf91-2be6-48c3-ac8a-da7096482745-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-eb45bf91-2be6-48c3-ac8a-da7096482745" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-eb45bf91-2be6-48c3-ac8a-da7096482745" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot eb45bf91-2be6-48c3-ac8a-da7096482745 of volume 19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a88735b-8008-4ef2-a20d-26b0f2a8e019]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Delete snapshot completed successfully. Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-92eebccd-e7bd-40b6-b755-5a530eee6d5c tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-16979a06-9e5f-4426-b73d-9570f3faefa2-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:25 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 Sep 25 16:30:25 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745" returned: 0 in 0.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19878cb2-9ae6-4ead-9eca-4115028c28f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca4052f-1689-43c8-b6b8-d030b51421b2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 Sep 25 16:30:25 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-2842323d-4fdd-4d93-9c8f-16e6449b3868-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-2842323d-4fdd-4d93-9c8f-16e6449b3868-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb721f2-ecc5-4285-9962-e0b43026ffa0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1" returned: 0 in 0.480s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 Sep 25 16:30:25 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:25 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:26 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745" returned: 0 in 0.445s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:26 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868 Sep 25 16:30:26 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745 Sep 25 16:30:26 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1.eb45bf91-2be6-48c3-ac8a-da7096482745" returned: 0 in 0.297s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-2842323d-4fdd-4d93-9c8f-16e6449b3868" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-eb45bf91-2be6-48c3-ac8a-da7096482745" released by "_delete_snapshot" :: held 1.797s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" released by "delete_snapshot" :: held 1.846s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-2842323d-4fdd-4d93-9c8f-16e6449b3868" released by "delete_volume" :: held 0.961s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Created reservations ['dd94633b-5bb6-471f-9f38-9978d6a92bd7', '34668c35-ae8e-42da-b88c-cb979c3c175c', '3274966a-02c5-447c-8306-06b06882dd74', '55fcabb2-4680-4d31-9096-1d5bd68775fd'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Created reservations ['a8908c82-2cf4-4a86-bac7-f4b3db4ea8f6', 'd36ffd95-ca71-4e36-bd1f-8c0e0e168853', '84a8ba95-e829-49a4-835a-24694d2b7344', '58c29a90-7467-4d44-bf27-82e102386a78'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-19878cb2-9ae6-4ead-9eca-4115028c28f1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:27 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:27 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-19878cb2-9ae6-4ead-9eca-4115028c28f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-783a38d2-0b6d-4683-9fc8-1d215de83d28 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-eb45bf91-2be6-48c3-ac8a-da7096482745-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2b07e-35c7-4fd0-87d2-09f6636a4c51]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.359s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:27 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 Sep 25 16:30:27 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Deleted volume successfully. Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d824c8d7-87e7-4990-9d90-4eefdf77e2be tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-2842323d-4fdd-4d93-9c8f-16e6449b3868-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (a45ed00c-3b79-42bc-8a5d-5e3448f49ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9288ca44-f677-4068-bd42-7fe6e97f759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9288ca44-f677-4068-bd42-7fe6e97f759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-972269718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4f1f08-a750-40a8-842a-8802d68ab1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:27Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3b0f0-d6dc-42ef-8672-9a762ffc954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3b0f0-d6dc-42ef-8672-9a762ffc954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464881d1-4025-4a3a-93bf-4dfb010b93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464881d1-4025-4a3a-93bf-4dfb010b93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4f1f08-a750-40a8-842a-8802d68ab1b6', 'volume_name': 'volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7270574d-3f62-4534-b605-dd482f689455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7270574d-3f62-4534-b605-dd482f689455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8ba2c5-0165-4431-9554-05130b74b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume 6f4f1f08-a750-40a8-842a-8802d68ab1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6', 'volume_size': 1} Sep 25 16:30:27 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-972269718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4f1f08-a750-40a8-842a-8802d68ab1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:27Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume 6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1" returned: 0 in 0.486s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 1073741824 Sep 25 16:30:27 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:27 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1 Sep 25 16:30:27 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-28de443c-dea9-428c-8b0f-58eff8f7ee51-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:28 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-28de443c-dea9-428c-8b0f-58eff8f7ee51-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-19878cb2-9ae6-4ead-9eca-4115028c28f1" returned: 0 in 0.372s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-19878cb2-9ae6-4ead-9eca-4115028c28f1" released by "delete_volume" :: held 0.953s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d6604-081b-4787-9e14-09952e4f3afc]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Created reservations ['cb22b1ed-ed54-448e-b416-c3464ae3bf78', 'f06bd0db-a13a-4265-bda3-ede1a09c6dfc', '23f7fed7-1260-4691-804c-9caa7f21fda5', 'b30248de-76ef-445d-b9bf-b1511478e0a2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 1073741824" returned: 0 in 0.708s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 Sep 25 16:30:28 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:28 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 Sep 25 16:30:28 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:30:28 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51" returned: 0 in 0.501s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51 Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6" returned: 0 in 0.322s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:28 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8ba2c5-0165-4431-9554-05130b74b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26103870-e948-4d25-a34d-27417778b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0b576bfc-a181-47f0-880e-fb3a109940e3 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-19878cb2-9ae6-4ead-9eca-4115028c28f1-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 (6f4f1f08-a750-40a8-842a-8802d68ab1b6): created successfully Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26103870-e948-4d25-a34d-27417778b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (a45ed00c-3b79-42bc-8a5d-5e3448f49ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-32eb4fa3-dfc8-4447-8b93-1692a4028637 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:29 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28de443c-dea9-428c-8b0f-58eff8f7ee51" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-quobyte-28de443c-dea9-428c-8b0f-58eff8f7ee51" released by "delete_volume" :: held 0.868s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Created reservations ['547fbee3-190f-46b0-bdae-fd7a8d142c3a', 'c2fdea04-8a86-4914-b284-c8a41200fb49', '1436ea09-bdfe-4639-b887-9f6d39137d06', '0cc8b90b-466a-4ec5-82a6-895229779d92'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:29 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:29 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:29 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.293s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Deleted volume successfully. Sep 25 16:30:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222ee8f-5dce-4996-a6ac-04873dd5c49e tempest-VolumeDependencyTests-1198813550 None] Lock "cinder-28de443c-dea9-428c-8b0f-58eff8f7ee51-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating offline snapshot 67375c2c-bf44-4fce-8bab-593dd7db74d2 of volume 6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (0ad3fed6-6844-405a-ad0f-8bcd0593ec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c13e9f-3747-480e-b12f-eb0a66b6b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332da21-0ff3-467c-907e-f37f94ec9fe6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c13e9f-3747-480e-b12f-eb0a66b6b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942796599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29133bb-1b46-4631-ba9c-f4a4d3ec417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:30Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dfc73c-06e1-4896-b1d6-3ed69389d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dfc73c-06e1-4896-b1d6-3ed69389d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba95ce71-1541-4048-acf2-ddfdd1761b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba95ce71-1541-4048-acf2-ddfdd1761b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29133bb-1b46-4631-ba9c-f4a4d3ec417f', 'volume_name': 'volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25ea757-2200-41df-855b-3985dda06358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25ea757-2200-41df-855b-3985dda06358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118d86e1-fced-4521-aae0-fe6373791d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Volume d29133bb-1b46-4631-ba9c-f4a4d3ec417f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f', 'volume_size': 1} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:30 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 Sep 25 16:30:30 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:30 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6" returned: 0 in 0.409s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:30 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 1G Sep 25 16:30:30 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:31 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 1G" returned: 0 in 0.555s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:31 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 Sep 25 16:30:31 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:31 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2" returned: 0 in 0.311s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:31 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 is being set with open permissions: ugo+rw Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:31 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 Sep 25 16:30:31 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:31 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:31 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info Sep 25 16:30:31 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info" returned: 0 in 0.277s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info is being set with open permissions: ugo+rw Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:32 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info Sep 25 16:30:32 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.info" returned: 0 in 0.388s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942796599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29133bb-1b46-4631-ba9c-f4a4d3ec417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:30Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Creating volume d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:32 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f 1073741824 Sep 25 16:30:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e049fc18-2ed9-4a72-b737-730a28d65680 tempest-CreateVolumesFromSnapshotTest-396148781 None] Create snapshot completed successfully Sep 25 16:30:32 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Flow 'volume_create_manager' (1dffb766-9f19-4289-9e45-1de0eb4e4838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141c18f0-e6f2-4bdd-9186-00a633f9b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141c18f0-e6f2-4bdd-9186-00a633f9b8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7398c-731b-4f51-bdcc-d18cc4c79aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff07f7a556ba4250b7be2b0767d1489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:33Z,use_quota=True,user_id='c4708fd882344da1bac70d309ff2befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916e962e-10ef-466e-b2a6-cc887f61c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916e962e-10ef-466e-b2a6-cc887f61c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019abf2d-9780-40fb-abbf-ed9793ec11e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019abf2d-9780-40fb-abbf-ed9793ec11e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a7398c-731b-4f51-bdcc-d18cc4c79aa9', 'volume_name': 'volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bd1e0-8b94-4910-87fa-0c6aeb004868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bd1e0-8b94-4910-87fa-0c6aeb004868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad4f15a-8e12-4756-8701-85bab0e4c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Volume 89a7398c-731b-4f51-bdcc-d18cc4c79aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9', 'volume_size': 1} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:33 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f 1073741824" returned: 0 in 0.641s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:33 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f Sep 25 16:30:33 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:33 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7398c-731b-4f51-bdcc-d18cc4c79aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff07f7a556ba4250b7be2b0767d1489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:33Z,use_quota=True,user_id='c4708fd882344da1bac70d309ff2befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Creating volume 89a7398c-731b-4f51-bdcc-d18cc4c79aa9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:33 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:33 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 1073741824 Sep 25 16:30:33 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (1a5c359d-fd24-49fa-aad1-eefc74d59330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d96aeda-f44d-45d1-bb95-fd4244f63e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118d86e1-fced-4521-aae0-fe6373791d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536a76a5-a1e1-4a6f-8b0d-f6e4348efece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d96aeda-f44d-45d1-bb95-fd4244f63e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803385204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867debde-6f67-4d32-b34a-99e03db92eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:34Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f03068-24a7-4c9d-813c-cd58e11fbc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f03068-24a7-4c9d-813c-cd58e11fbc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9105bd-6761-4b9a-9329-12f5851dbe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9105bd-6761-4b9a-9329-12f5851dbe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867debde-6f67-4d32-b34a-99e03db92eb5', 'volume_name': 'volume-867debde-6f67-4d32-b34a-99e03db92eb5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91be64fd-88f7-4b4f-9c27-d2b404e6f770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91be64fd-88f7-4b4f-9c27-d2b404e6f770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b257f56-1813-4a3b-820f-6d75aeded4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume 867debde-6f67-4d32-b34a-99e03db92eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867debde-6f67-4d32-b34a-99e03db92eb5', 'volume_size': 1} Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Volume volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f (d29133bb-1b46-4631-ba9c-f4a4d3ec417f): created successfully Sep 25 16:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536a76a5-a1e1-4a6f-8b0d-f6e4348efece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (0ad3fed6-6844-405a-ad0f-8bcd0593ec0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9fafd9eb-e387-46f4-8497-bbd6c5650200 tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (6c8e5b46-6996-4459-a8c9-bc75b1e3b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:34 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aba83c-b2b6-4159-ab6b-2b6d935f214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 1073741824" returned: 0 in 0.647s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aba83c-b2b6-4159-ab6b-2b6d935f214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000739501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c97b9f5-9251-4002-bd40-3e370d18171e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:34Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e5948d-77a1-49e5-8e07-2dea8a3e1eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e5948d-77a1-49e5-8e07-2dea8a3e1eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb60b195-c2d7-4e14-9f86-78f93c0bf440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb60b195-c2d7-4e14-9f86-78f93c0bf440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c97b9f5-9251-4002-bd40-3e370d18171e', 'volume_name': 'volume-6c97b9f5-9251-4002-bd40-3e370d18171e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498cfbb-e7a9-4d70-a049-3faddb47f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498cfbb-e7a9-4d70-a049-3faddb47f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e81f74-530e-4599-8a9f-382ceba28ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume 6c97b9f5-9251-4002-bd40-3e370d18171e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c97b9f5-9251-4002-bd40-3e370d18171e', 'volume_size': 1} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:34 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 Sep 25 16:30:34 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:34 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" returned: 0 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803385204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867debde-6f67-4d32-b34a-99e03db92eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:34Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume 867debde-6f67-4d32-b34a-99e03db92eb5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:34 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad4f15a-8e12-4756-8701-85bab0e4c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 1073741824 Sep 25 16:30:34 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c848cbd-6f29-4ba2-b15a-1fdd6c21cab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Volume volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 (89a7398c-731b-4f51-bdcc-d18cc4c79aa9): created successfully Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c848cbd-6f29-4ba2-b15a-1fdd6c21cab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Flow 'volume_create_manager' (1dffb766-9f19-4289-9e45-1de0eb4e4838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (a92f4773-bcb8-43f2-af67-12b695554546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3569f0-f920-412c-9d30-aab0da7aa639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8a95db0c-70ca-4fb1-838e-d237a40b41f0 tempest-CinderUnicodeTest-1645357687 None] Created volume successfully. Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3569f0-f920-412c-9d30-aab0da7aa639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766643031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d75daf-4ea2-4e98-8c75-10fe999751d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc083dc-f04b-4d59-b420-4151cd83268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc083dc-f04b-4d59-b420-4151cd83268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe20d37-63c7-48c7-b411-7ecbb76d5644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe20d37-63c7-48c7-b411-7ecbb76d5644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d75daf-4ea2-4e98-8c75-10fe999751d4', 'volume_name': 'volume-99d75daf-4ea2-4e98-8c75-10fe999751d4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a209bf-a8cd-4188-8c0f-5d5a49c76c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a209bf-a8cd-4188-8c0f-5d5a49c76c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549998e-46c8-45f3-b96d-05f4bbc28419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume 99d75daf-4ea2-4e98-8c75-10fe999751d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d75daf-4ea2-4e98-8c75-10fe999751d4', 'volume_size': 1} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (b63d3c2d-dc0c-4a15-b951-74e9e4e10b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e896f125-1ba8-4ed2-a2e8-8620c5dd1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e896f125-1ba8-4ed2-a2e8-8620c5dd1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288606100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa00cdf7-b899-4c50-8195-e2054c89d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72108049-074f-4179-9122-b0888c85acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72108049-074f-4179-9122-b0888c85acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeede36-ee81-43b8-9890-c188e9f72eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeede36-ee81-43b8-9890-c188e9f72eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa00cdf7-b899-4c50-8195-e2054c89d16c', 'volume_name': 'volume-aa00cdf7-b899-4c50-8195-e2054c89d16c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6701659a-03a9-4950-af8a-188692ee2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6701659a-03a9-4950-af8a-188692ee2d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33220690-585d-4726-96dd-c969dbaff922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume aa00cdf7-b899-4c50-8195-e2054c89d16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa00cdf7-b899-4c50-8195-e2054c89d16c', 'volume_size': 1} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:35 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 1073741824" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:35 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 Sep 25 16:30:35 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:36 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5" returned: 0 in 0.362s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000739501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c97b9f5-9251-4002-bd40-3e370d18171e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:34Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume 6c97b9f5-9251-4002-bd40-3e370d18171e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:36 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e 1073741824 Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b257f56-1813-4a3b-820f-6d75aeded4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867debde-6f67-4d32-b34a-99e03db92eb5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eefe9c4-14d1-4571-be1d-0a3d87c053f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-867debde-6f67-4d32-b34a-99e03db92eb5 (867debde-6f67-4d32-b34a-99e03db92eb5): created successfully Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eefe9c4-14d1-4571-be1d-0a3d87c053f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (1a5c359d-fd24-49fa-aad1-eefc74d59330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8d41748f-6a94-440d-95d8-0bf9709be5ea tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Flow 'volume_create_manager' (ad643ffb-2641-4eb1-b56d-25463c685872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b668058-441e-4e5f-a38c-ca740a00e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b668058-441e-4e5f-a38c-ca740a00e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1558692268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caffddf4-b9ba-42d3-8674-c178a4d7ad51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff07f7a556ba4250b7be2b0767d1489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:36Z,use_quota=True,user_id='c4708fd882344da1bac70d309ff2befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f761522b-29e6-408c-8063-d5eed1fc419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f761522b-29e6-408c-8063-d5eed1fc419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d603b-af90-454c-a6ca-1da62f4f2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d603b-af90-454c-a6ca-1da62f4f2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caffddf4-b9ba-42d3-8674-c178a4d7ad51', 'volume_name': 'volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7c212-c638-4115-b59d-b0620b158d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7c212-c638-4115-b59d-b0620b158d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987a8b09-4b77-449f-af6e-5e5a83248e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Volume caffddf4-b9ba-42d3-8674-c178a4d7ad51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51', 'volume_size': 1} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (6fbc90d3-016c-4628-a7d5-e9038147363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86715e6-ced8-471a-9564-c49b717bbb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86715e6-ced8-471a-9564-c49b717bbb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527805072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56147f4c-6a24-4d03-b49c-19371f3f75b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:36Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ebb66-d308-481e-a39b-92f9e30663a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ebb66-d308-481e-a39b-92f9e30663a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42466ceb-940c-47a9-a527-125f58a95dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42466ceb-940c-47a9-a527-125f58a95dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56147f4c-6a24-4d03-b49c-19371f3f75b7', 'volume_name': 'volume-56147f4c-6a24-4d03-b49c-19371f3f75b7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d5f67-5b80-4058-8fb3-8a729e53607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d5f67-5b80-4058-8fb3-8a729e53607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d942e364-e017-4c4c-ae96-dd430627de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume 56147f4c-6a24-4d03-b49c-19371f3f75b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56147f4c-6a24-4d03-b49c-19371f3f75b7', 'volume_size': 1} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:36 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e 1073741824" returned: 0 in 0.568s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:36 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e Sep 25 16:30:36 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:36 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e" returned: 0 in 0.273s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.264s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e81f74-530e-4599-8a9f-382ceba28ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c97b9f5-9251-4002-bd40-3e370d18171e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a35739e-9347-47b6-9728-2b859f5dfccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot 476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 of volume d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-6c97b9f5-9251-4002-bd40-3e370d18171e (6c97b9f5-9251-4002-bd40-3e370d18171e): created successfully Sep 25 16:30:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a35739e-9347-47b6-9728-2b859f5dfccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (6c8e5b46-6996-4459-a8c9-bc75b1e3b11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8d378-8932-4bc5-ac50-ed7d0c666950]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0592f718-bb1b-4b7d-9fc3-0f2fc87ecc38 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:37 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f Sep 25 16:30:37 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:37 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" returned: 0 in 0.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 1G Sep 25 16:30:37 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:37 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 1G" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 Sep 25 16:30:37 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:38 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" returned: 0 in 0.364s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:38 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 is being set with open permissions: ugo+rw Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:38 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 Sep 25 16:30:38 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:38 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" returned: 0 in 0.244s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=260,cinder:SELECT=197,cinder:INSERT=74,cinder:DELETE=27 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=185,cinder:UPDATE=237,cinder:INSERT=61,cinder:DELETE=19 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:38 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info Sep 25 16:30:38 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:38 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info" returned: 0 in 0.307s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:38 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info is being set with open permissions: ugo+rw Sep 25 16:30:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:38 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info Sep 25 16:30:38 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:39 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.info" returned: 0 in 0.265s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.970s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766643031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d75daf-4ea2-4e98-8c75-10fe999751d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume 99d75daf-4ea2-4e98-8c75-10fe999751d4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:39 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 1073741824 Sep 25 16:30:39 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a68a564c-1b04-4ecd-9eea-cdf99053d34f tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:30:39 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 1073741824" returned: 0 in 0.559s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:39 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 Sep 25 16:30:39 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:39 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4" returned: 0 in 0.285s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.416s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288606100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa00cdf7-b899-4c50-8195-e2054c89d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume aa00cdf7-b899-4c50-8195-e2054c89d16c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:40 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c 1073741824 Sep 25 16:30:40 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549998e-46c8-45f3-b96d-05f4bbc28419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d75daf-4ea2-4e98-8c75-10fe999751d4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3797141-2b44-45e7-96d7-1cb1eff22959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 (99d75daf-4ea2-4e98-8c75-10fe999751d4): created successfully Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3797141-2b44-45e7-96d7-1cb1eff22959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (a92f4773-bcb8-43f2-af67-12b695554546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-201f7eea-ff2f-4fc3-b82a-664dfd0e53ca tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot 476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 of volume d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ce630-8199-42ff-812b-822be8377cb3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 Sep 25 16:30:40 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c 1073741824" returned: 0 in 0.648s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c Sep 25 16:30:40 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" returned: 0 in 0.492s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[565789a0-bb63-4fee-99d5-00b28679421d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f Sep 25 16:30:40 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c" returned: 0 in 0.267s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.454s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1558692268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caffddf4-b9ba-42d3-8674-c178a4d7ad51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff07f7a556ba4250b7be2b0767d1489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:36Z,use_quota=True,user_id='c4708fd882344da1bac70d309ff2befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Creating volume caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33220690-585d-4726-96dd-c969dbaff922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa00cdf7-b899-4c50-8195-e2054c89d16c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517e9c48-1019-4944-8204-acfb1db9c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:41 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 1073741824 Sep 25 16:30:41 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-aa00cdf7-b899-4c50-8195-e2054c89d16c (aa00cdf7-b899-4c50-8195-e2054c89d16c): created successfully Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517e9c48-1019-4944-8204-acfb1db9c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (b63d3c2d-dc0c-4a15-b951-74e9e4e10b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-91d9894a-9033-4038-a649-0767010e68b2 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:41 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" returned: 0 in 0.432s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:41 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 Sep 25 16:30:41 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 1073741824" returned: 0 in 0.600s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:41 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 Sep 25 16:30:41 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:41 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6 Sep 25 16:30:41 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.299s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527805072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56147f4c-6a24-4d03-b49c-19371f3f75b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f93acdb13c4c9e9700b85d548aae55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:36Z,use_quota=True,user_id='509b296d2e9e43849c5d2a98f7d53a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Creating volume 56147f4c-6a24-4d03-b49c-19371f3f75b7 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987a8b09-4b77-449f-af6e-5e5a83248e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:41 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 1073741824 Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e29aa02-c619-4284-a5ec-ad2204554469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:41 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Volume volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 (caffddf4-b9ba-42d3-8674-c178a4d7ad51): created successfully Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e29aa02-c619-4284-a5ec-ad2204554469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:41 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Flow 'volume_create_manager' (ad643ffb-2641-4eb1-b56d-25463c685872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f.476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6" released by "_delete_snapshot" :: held 1.818s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-72ac5da6-c0de-4530-aa49-240f40f75537 tempest-CinderUnicodeTest-1645357687 None] Created volume successfully. Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" released by "delete_snapshot" :: held 1.856s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Created reservations ['cf58a695-cf27-4ccd-8222-508d37d992f8', '15f59af0-7e0b-4fe1-b3cb-86848702861b', 'da9c0811-6b8f-48ab-a39a-8fb7cd15c8a7', '086bad84-6830-404d-8c94-fd3f5fde0fb9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-949d09ff-7115-4246-9adf-309bc7563451 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-476e76d3-a6fb-4217-a5c6-78e45ddb3bd6-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:42 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 1073741824" returned: 0 in 0.649s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:42 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 Sep 25 16:30:42 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:42 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7" returned: 0 in 0.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.218s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d942e364-e017-4c4c-ae96-dd430627de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56147f4c-6a24-4d03-b49c-19371f3f75b7', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124588b1-0a0f-44ef-a9c0-dfe4e0e4c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Creating offline snapshot 5c5a4208-3aee-4b0d-92f1-d6c1d528e96a of volume caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Volume volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 (56147f4c-6a24-4d03-b49c-19371f3f75b7): created successfully Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124588b1-0a0f-44ef-a9c0-dfe4e0e4c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Flow 'volume_create_manager' (6fbc90d3-016c-4628-a7d5-e9038147363b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbf3ac-e618-4f27-b0c6-5822e673ebb1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-43b0d243-8624-4b95-8765-4cfbd28aa1a6 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created volume successfully. Sep 25 16:30:43 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 Sep 25 16:30:43 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-d29133bb-1b46-4631-ba9c-f4a4d3ec417f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-d29133bb-1b46-4631-ba9c-f4a4d3ec417f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e93e761-e1ec-409b-82f0-4e97d01e4ef5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:43 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51" returned: 0 in 0.440s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:43 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a 1G Sep 25 16:30:43 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:43 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f Sep 25 16:30:43 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-56147f4c-6a24-4d03-b49c-19371f3f75b7-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:43 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" returned: 0 in 0.443s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-56147f4c-6a24-4d03-b49c-19371f3f75b7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:43 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f Sep 25 16:30:43 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-56147f4c-6a24-4d03-b49c-19371f3f75b7" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-56147f4c-6a24-4d03-b49c-19371f3f75b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:44 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a 1G" returned: 0 in 0.560s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05aa1fb-ea0e-427e-8ca8-2deca36ff32e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a Sep 25 16:30:44 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:44 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 Sep 25 16:30:44 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:44 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" returned: 0 in 0.322s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-d29133bb-1b46-4631-ba9c-f4a4d3ec417f" released by "delete_volume" :: held 0.876s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Created reservations ['69b3eaa3-7a48-47f1-8fc1-4dec72fe7d49', 'efc791c5-307c-4714-9e01-076c873a81c0', '2670f3b2-f1e9-4665-9e65-0c945e7c5459', '7e66a300-dad2-4b1c-9d0d-1fccc6a7db0f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:44 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" returned: 0 in 0.361s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a is being set with open permissions: ugo+rw Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a Sep 25 16:30:44 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:44 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:44 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7" returned: 0 in 0.559s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7 Sep 25 16:30:44 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:44 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.387s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bee16f57-bcb7-4799-bc8b-f2630edfeeb0 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-d29133bb-1b46-4631-ba9c-f4a4d3ec417f-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:44 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info Sep 25 16:30:44 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:45 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-56147f4c-6a24-4d03-b49c-19371f3f75b7" returned: 0 in 0.436s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-56147f4c-6a24-4d03-b49c-19371f3f75b7" released by "delete_volume" :: held 1.087s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['902c6d42-0e75-48cd-9884-59163535ea92', '4a874cb2-1e34-4652-9937-2c9fa872bda8', 'e76e3e72-cf08-4d47-81a1-eac34447fafb', 'f8b305e5-09a1-40d0-be1d-92fc169369e5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:45 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info" returned: 0 in 0.348s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:45 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:45 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info is being set with open permissions: ugo+rw Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:45 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info Sep 25 16:30:45 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (28745f9d-a783-49d9-8390-eb84fc204ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549681d4-fbe7-4f9d-b948-2b0335c83e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549681d4-fbe7-4f9d-b948-2b0335c83e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856290200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf80f839-3d9b-40c2-8378-78efb2d12792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:45Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e61d707-49f5-4f5d-bc65-43c921a773e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e61d707-49f5-4f5d-bc65-43c921a773e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d21f0a-742d-402e-88a8-2454b5a96669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d21f0a-742d-402e-88a8-2454b5a96669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf80f839-3d9b-40c2-8378-78efb2d12792', 'volume_name': 'volume-bf80f839-3d9b-40c2-8378-78efb2d12792', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53543b57-815c-43f4-aa24-064783f9f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53543b57-815c-43f4-aa24-064783f9f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213c1b1d-a49f-4a7e-9db8-0c3f5e1c11c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Volume bf80f839-3d9b-40c2-8378-78efb2d12792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf80f839-3d9b-40c2-8378-78efb2d12792', 'volume_size': 1} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:45 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.283s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9beadc23-d905-4234-b9b3-fa28e070d6fe tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-56147f4c-6a24-4d03-b49c-19371f3f75b7-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:45 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.info" returned: 0 in 0.288s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856290200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf80f839-3d9b-40c2-8378-78efb2d12792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:45Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Creating volume bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:45 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 1073741824 Sep 25 16:30:45 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-671700c3-5df8-49aa-aa28-7e39465f1898 tempest-CinderUnicodeTest-1645357687 None] Create snapshot completed successfully Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-quobyte-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Deleting offline snapshot 5c5a4208-3aee-4b0d-92f1-d6c1d528e96a of volume caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] snapshot_file for this snap is: volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8437339-36b4-4f1d-a65d-e43fa2878fe1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:46 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 1073741824" returned: 0 in 0.483s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:46 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 Sep 25 16:30:46 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:46 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a Sep 25 16:30:46 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-aa00cdf7-b899-4c50-8195-e2054c89d16c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-aa00cdf7-b899-4c50-8195-e2054c89d16c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-aa00cdf7-b899-4c50-8195-e2054c89d16c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-aa00cdf7-b899-4c50-8195-e2054c89d16c" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ae809-aa75-4a9f-8c40-018a8d8f9f2f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:46 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:46 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c Sep 25 16:30:46 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213c1b1d-a49f-4a7e-9db8-0c3f5e1c11c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf80f839-3d9b-40c2-8378-78efb2d12792', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:46 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85889ff-fa60-48c1-8ba5-e3d85bc88946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" returned: 0 in 0.595s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Volume volume-bf80f839-3d9b-40c2-8378-78efb2d12792 (bf80f839-3d9b-40c2-8378-78efb2d12792): created successfully Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85889ff-fa60-48c1-8ba5-e3d85bc88946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (28745f9d-a783-49d9-8390-eb84fc204ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d03adab-9f01-4acb-9d7a-fd5787fc2ee8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c0340aca-10fc-48b5-beea-bb7149bbc478 tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:30:46 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 Sep 25 16:30:46 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:46 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c" returned: 0 in 0.515s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:46 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c Sep 25 16:30:46 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:47 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51" returned: 0 in 0.430s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:47 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a Sep 25 16:30:47 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:47 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-aa00cdf7-b899-4c50-8195-e2054c89d16c" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-aa00cdf7-b899-4c50-8195-e2054c89d16c" released by "delete_volume" :: held 0.894s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['a664a2d5-7330-43c2-9ce6-6304010a12be', '4629be30-962c-4945-bd40-9131c54e714a', 'f2331ea7-736b-4349-a700-2b40a318045e', '08b4b961-4b70-4ccb-b1a4-565511dc0fce'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:47 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:47 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-99d75daf-4ea2-4e98-8c75-10fe999751d4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-99d75daf-4ea2-4e98-8c75-10fe999751d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:47 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" returned: 0 in 0.513s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-99d75daf-4ea2-4e98-8c75-10fe999751d4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:47 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a Sep 25 16:30:47 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-99d75daf-4ea2-4e98-8c75-10fe999751d4" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7afeba-9938-4a06-bb52-f3db96d3b0d8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:47 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.443s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8ee3be11-f8a8-4d0e-a219-a93bd3ce5dc9 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-aa00cdf7-b899-4c50-8195-e2054c89d16c-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot b71430fd-5e93-477d-a672-9385cf9d005b of volume bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:47 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 Sep 25 16:30:47 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5648fc-40dc-496a-9376-ef45ffab7c36]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:48 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51.5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" returned: 0 in 0.406s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a" released by "_delete_snapshot" :: held 2.111s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" released by "delete_snapshot" :: held 2.142s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:48 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 Sep 25 16:30:48 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Created reservations ['86ac2bd9-95d6-4105-a790-503373bfd533', '3019cee9-ae47-402f-9077-cbc0d60c28fc', '313b0daf-1f10-432d-8fda-fdecac89a5e6', 'afa9c46d-a697-4cf3-b394-279686512556'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Delete snapshot completed successfully. Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-76af967b-5301-49df-9701-9a17fb2e6d80 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-5c5a4208-3aee-4b0d-92f1-d6c1d528e96a-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:48 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4" returned: 0 in 0.605s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:48 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4 Sep 25 16:30:48 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:48 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792" returned: 0 in 0.487s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:48 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b 1G Sep 25 16:30:48 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:48 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-99d75daf-4ea2-4e98-8c75-10fe999751d4" returned: 0 in 0.289s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-99d75daf-4ea2-4e98-8c75-10fe999751d4" released by "delete_volume" :: held 0.965s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['a2bb2978-f513-4f56-b345-44e23c837ffa', '8574f31e-92a3-4ebb-884e-9c4ecdd4d47c', '9a3fd187-0b17-44d9-b86a-bb646dcf7480', '22c2edb3-c0c8-4faa-a2e1-70115ef45458'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:48 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:48 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b 1G" returned: 0 in 0.557s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf80f839-3d9b-40c2-8378-78efb2d12792 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:49 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf80f839-3d9b-40c2-8378-78efb2d12792 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b Sep 25 16:30:49 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.347s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-caffddf4-b9ba-42d3-8674-c178a4d7ad51-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-caffddf4-b9ba-42d3-8674-c178a4d7ad51-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ded281cb-ec67-4749-96ca-b0e2207b3573 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-99d75daf-4ea2-4e98-8c75-10fe999751d4-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[08195f7d-aa0b-4a6e-8932-f0195bae32f2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:49 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf80f839-3d9b-40c2-8378-78efb2d12792 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b" returned: 0 in 0.435s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:49 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b is being set with open permissions: ugo+rw Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:49 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 Sep 25 16:30:49 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b Sep 25 16:30:49 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:49 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51" returned: 0 in 0.399s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:49 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51 Sep 25 16:30:49 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info Sep 25 16:30:49 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-6c97b9f5-9251-4002-bd40-3e370d18171e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-6c97b9f5-9251-4002-bd40-3e370d18171e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-6c97b9f5-9251-4002-bd40-3e370d18171e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6c97b9f5-9251-4002-bd40-3e370d18171e" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7692cc21-4722-442a-a93f-04d91e4f9db4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:50 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-caffddf4-b9ba-42d3-8674-c178a4d7ad51" returned: 0 in 0.413s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:50 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info" returned: 0 in 0.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:50 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info is being set with open permissions: ugo+rw Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-caffddf4-b9ba-42d3-8674-c178a4d7ad51" released by "delete_volume" :: held 0.923s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:50 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info Sep 25 16:30:50 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:50 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e Sep 25 16:30:50 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Created reservations ['18cbbaa4-dc6b-4aea-b75b-de5c05091c6c', '798609b7-97df-4adb-a377-7c64fe4d6cd6', '16d86d95-b8b0-4526-a5e9-bead57840f6f', '71ad8a10-014a-47ea-b762-1cd1d261bf77'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:50 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:50 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:50 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.info" returned: 0 in 0.333s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-08c6acd0-2b1d-48be-b044-308b7a6663c9 tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:30:50 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e" returned: 0 in 0.545s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:50 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e Sep 25 16:30:50 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:50 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.306s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Deleted volume successfully. Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9d11edd8-c916-40b9-aa47-db4975093ac0 tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-caffddf4-b9ba-42d3-8674-c178a4d7ad51-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:50 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6c97b9f5-9251-4002-bd40-3e370d18171e" returned: 0 in 0.355s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6c97b9f5-9251-4002-bd40-3e370d18171e" released by "delete_volume" :: held 0.986s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['b1124bf0-bf7d-4a25-b122-73619bfb6d0f', '09258d75-ac98-44c6-8f77-b9f061647440', 'd89926eb-9049-4f3c-ab81-6e529903ced9', 'e9a613d3-0771-4bf2-944d-2b15cdc16c96'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-b71430fd-5e93-477d-a672-9385cf9d005b-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-b71430fd-5e93-477d-a672-9385cf9d005b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:51 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:51 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-b71430fd-5e93-477d-a672-9385cf9d005b" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-b71430fd-5e93-477d-a672-9385cf9d005b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot b71430fd-5e93-477d-a672-9385cf9d005b of volume bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303c454-c710-42b0-8c81-3694c32f21c3]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:51 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b Sep 25 16:30:51 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:51 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-89a7398c-731b-4f51-bdcc-d18cc4c79aa9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.312s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-89a7398c-731b-4f51-bdcc-d18cc4c79aa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3903328a-e0b7-4051-961b-798998b69666 tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-6c97b9f5-9251-4002-bd40-3e370d18171e-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "cinder-quobyte-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee12cd0-cc7c-4c45-af5a-65b21de36bbd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:51 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b" returned: 0 in 0.422s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf80f839-3d9b-40c2-8378-78efb2d12792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:51 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 Sep 25 16:30:51 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84b07e-63e4-4402-a5ab-959c870b1b40]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:51 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 Sep 25 16:30:51 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:52 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" returned: 0 in 0.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:52 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9 Sep 25 16:30:52 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:52 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792" returned: 0 in 0.414s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:52 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b Sep 25 16:30:52 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-867debde-6f67-4d32-b34a-99e03db92eb5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-867debde-6f67-4d32-b34a-99e03db92eb5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-867debde-6f67-4d32-b34a-99e03db92eb5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-867debde-6f67-4d32-b34a-99e03db92eb5" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b159d-05f3-4fc4-87da-70391c146dc8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:52 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" returned: 0 in 0.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-quobyte-89a7398c-731b-4f51-bdcc-d18cc4c79aa9" released by "delete_volume" :: held 0.873s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:52 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 Sep 25 16:30:52 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Created reservations ['6c7af105-2f3c-4d77-bb07-ee0f7e3df795', 'ac92b413-fed3-4dd9-b352-ce78bd1bb016', 'e7ef5cba-c2dc-4c5e-8c1e-4c73a09e574e', '462e3013-3af9-4f56-ba96-1c73da7a7a2b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:52 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b" returned: 0 in 0.550s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:52 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:52 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b Sep 25 16:30:52 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:52 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:53 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:53 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.348s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Deleted volume successfully. Sep 25 16:30:53 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5 Sep 25 16:30:53 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dae69f88-1552-42ae-9217-2c44581f8c3b tempest-CinderUnicodeTest-1645357687 None] Lock "cinder-89a7398c-731b-4f51-bdcc-d18cc4c79aa9-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:53 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792.b71430fd-5e93-477d-a672-9385cf9d005b" returned: 0 in 0.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-b71430fd-5e93-477d-a672-9385cf9d005b" released by "_delete_snapshot" :: held 2.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" released by "delete_snapshot" :: held 2.069s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:53 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-867debde-6f67-4d32-b34a-99e03db92eb5" returned: 0 in 0.318s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-867debde-6f67-4d32-b34a-99e03db92eb5" released by "delete_volume" :: held 1.084s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Created reservations ['4f5ab2da-331a-48ce-aeb9-0b9c5e228f07', '7945712e-3e45-44d0-901c-2878f43431d5', '63c126d0-fdac-4b1c-a3ac-f22d0657a2c3', '59c24a1a-d7e1-4dc0-9d0b-314d0f041086'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['f5d6b9b9-a203-45c2-864b-88a75ebab365', 'bd55be54-7235-48af-8acb-972e4b1c8701', '8dc3d2bf-913d-4f50-90a7-d4d315c4fa7c', '07ae0d07-e5b9-4057-ab86-1c927ef928a4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4238a463-b9e7-437c-94a5-bc5e98b90258 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-b71430fd-5e93-477d-a672-9385cf9d005b-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:53 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:53 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:53 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.303s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-305d258f-e8a4-4cd0-82ee-4fd5dcff4bef tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-867debde-6f67-4d32-b34a-99e03db92eb5-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-bf80f839-3d9b-40c2-8378-78efb2d12792-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-bf80f839-3d9b-40c2-8378-78efb2d12792-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac76b29e-065f-47a7-b9df-5c2fe53a6ad0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-67375c2c-bf44-4fce-8bab-593dd7db74d2-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-67375c2c-bf44-4fce-8bab-593dd7db74d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-67375c2c-bf44-4fce-8bab-593dd7db74d2" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:54 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 Sep 25 16:30:54 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-67375c2c-bf44-4fce-8bab-593dd7db74d2" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleting offline snapshot 67375c2c-bf44-4fce-8bab-593dd7db74d2 of volume 6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] snapshot_file for this snap is: volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e94db-d2d8-4b25-9c79-0e824e94c4c5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 Sep 25 16:30:55 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Flow 'volume_create_manager' (b45a095c-6cba-4212-8af3-b932c5b800fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159b599d-18f8-4f5e-80d8-00aa701d5df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159b599d-18f8-4f5e-80d8-00aa701d5df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1639066636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4438b40b-77ac-4356-be1e-0d1ee733cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470c034664894c74b1c41124758031a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:55Z,use_quota=True,user_id='7604a59d2bef470389a6b59bb567c156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af46c61a-2da7-4ab0-805e-d4e3f55d90c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af46c61a-2da7-4ab0-805e-d4e3f55d90c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb08d16-d1d1-4c3d-afcd-bea31fd3655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb08d16-d1d1-4c3d-afcd-bea31fd3655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4438b40b-77ac-4356-be1e-0d1ee733cac9', 'volume_name': 'volume-4438b40b-77ac-4356-be1e-0d1ee733cac9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532eb9b0-7426-4fea-9117-abed21fa9072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532eb9b0-7426-4fea-9117-abed21fa9072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac79812-7732-4291-a267-2b69a89b1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Volume 4438b40b-77ac-4356-be1e-0d1ee733cac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4438b40b-77ac-4356-be1e-0d1ee733cac9', 'volume_size': 1} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1639066636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4438b40b-77ac-4356-be1e-0d1ee733cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470c034664894c74b1c41124758031a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:55Z,use_quota=True,user_id='7604a59d2bef470389a6b59bb567c156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Creating volume 4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 1073741824 Sep 25 16:30:55 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792 Sep 25 16:30:55 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2" returned: 0 in 0.537s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2565c7-4149-4050-a73c-26e4b60814d0]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bf80f839-3d9b-40c2-8378-78efb2d12792" returned: 0 in 0.303s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-bf80f839-3d9b-40c2-8378-78efb2d12792" released by "delete_volume" :: held 1.096s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:55 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 Sep 25 16:30:55 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Created reservations ['bfe91c3b-8e2a-41ff-b68d-08b712068656', 'abac6586-7d89-4816-b5c6-00730ec78b8e', 'feae17ad-6a3f-4c8f-8a86-23b1610a809a', '8b92fb63-0b20-43a6-81d3-35c39a39dfa5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:55 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 1073741824" returned: 0 in 0.627s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6" returned: 0 in 0.476s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:56 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:30:56 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:56 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 Sep 25 16:30:56 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:56 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-78a48e9b-7366-48d1-90c6-e578a490c311 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-bf80f839-3d9b-40c2-8378-78efb2d12792-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:56 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.340s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac79812-7732-4291-a267-2b69a89b1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4438b40b-77ac-4356-be1e-0d1ee733cac9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0a8d0a-3dff-4f91-b1e0-43c4f7051c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Volume volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 (4438b40b-77ac-4356-be1e-0d1ee733cac9): created successfully Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0a8d0a-3dff-4f91-b1e0-43c4f7051c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Flow 'volume_create_manager' (b45a095c-6cba-4212-8af3-b932c5b800fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a171ee97-c291-4e71-9677-a61e16e66c6a tempest-SnapshotDependencyTests-1088299858 None] Created volume successfully. Sep 25 16:30:56 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:56 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2 Sep 25 16:30:56 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:56 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6.67375c2c-bf44-4fce-8bab-593dd7db74d2" returned: 0 in 0.254s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-67375c2c-bf44-4fce-8bab-593dd7db74d2" released by "_delete_snapshot" :: held 1.831s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" released by "delete_snapshot" :: held 1.883s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['40d37727-a5c8-48c9-9d30-2fd2069d288c', '3e39c713-5a05-4bf3-8f00-99294db1333f', '2a70b469-56c8-40c2-ba87-a05dddc1fdfa', 'b3367c8c-c66d-4486-9f14-f385b1f37d80'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Delete snapshot completed successfully. Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-157ae041-a92d-4e9e-9567-90584d184b7d tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-67375c2c-bf44-4fce-8bab-593dd7db74d2-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-6f4f1f08-a750-40a8-842a-8802d68ab1b6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-6f4f1f08-a750-40a8-842a-8802d68ab1b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda132a-2a5e-4cba-aef7-e98f8467286c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:57 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 Sep 25 16:30:57 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (662e974d-a4a0-4099-bbf0-0038ca0a4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba55d11-92a3-45f0-9678-e41454ae9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba55d11-92a3-45f0-9678-e41454ae9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490342199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a807e-61f8-463e-8c89-2e139ea39526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:57Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0b4444-fd7a-4a43-9e8f-8208abeb6812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0b4444-fd7a-4a43-9e8f-8208abeb6812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f81261b-deb4-4b84-82bd-96f77524eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f81261b-deb4-4b84-82bd-96f77524eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15a807e-61f8-463e-8c89-2e139ea39526', 'volume_name': 'volume-c15a807e-61f8-463e-8c89-2e139ea39526', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049b0bb2-d2ab-44b0-987e-0bcaedf8d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049b0bb2-d2ab-44b0-987e-0bcaedf8d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3a74de-f519-4a1f-b3bf-3ccd6578a1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Volume c15a807e-61f8-463e-8c89-2e139ea39526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15a807e-61f8-463e-8c89-2e139ea39526', 'volume_size': 1} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490342199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a807e-61f8-463e-8c89-2e139ea39526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:57Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Creating volume c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:57 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 1073741824 Sep 25 16:30:57 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:57 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6" returned: 0 in 0.506s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:57 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6 Sep 25 16:30:57 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:57 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-6f4f1f08-a750-40a8-842a-8802d68ab1b6" returned: 0 in 0.281s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-quobyte-6f4f1f08-a750-40a8-842a-8802d68ab1b6" released by "delete_volume" :: held 0.871s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Created reservations ['398f1c0f-125f-4124-af59-c3146130aa85', 'b2d8ccfe-7e8c-4650-b3b0-47f2be8a3f38', '146517d3-630c-41c9-ab07-b5b412837670', '4574c98f-f297-4102-8bb2-271184ec62b6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:30:58 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 1073741824" returned: 0 in 0.542s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 Sep 25 16:30:58 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Deleted volume successfully. Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12c10437-7825-4d54-9b14-2d2310f8499a tempest-CreateVolumesFromSnapshotTest-396148781 None] Lock "cinder-6f4f1f08-a750-40a8-842a-8802d68ab1b6-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:58 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526" returned: 0 in 0.316s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.856s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3a74de-f519-4a1f-b3bf-3ccd6578a1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15a807e-61f8-463e-8c89-2e139ea39526', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3ad167-0b27-4f60-bccc-cf304c4250f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Creating offline snapshot c3e389ae-cc57-49b6-a755-d54097420aec of volume 4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Volume volume-c15a807e-61f8-463e-8c89-2e139ea39526 (c15a807e-61f8-463e-8c89-2e139ea39526): created successfully Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3ad167-0b27-4f60-bccc-cf304c4250f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (662e974d-a4a0-4099-bbf0-0038ca0a4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a6f7d-bb1b-4c8d-8ecd-0faef7f46a53]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e3adec6e-3609-4513-913b-be705dedc973 tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:30:58 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:30:58 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.434s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec 1G Sep 25 16:30:58 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:59 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec 1G" returned: 0 in 0.504s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:59 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:30:59 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:59 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.401s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:59 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec is being set with open permissions: ugo+rw Sep 25 16:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:59 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:30:59 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:00 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.305s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:00 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info Sep 25 16:31:00 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:00 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info" returned: 0 in 0.280s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info is being set with open permissions: ugo+rw Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:00 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info Sep 25 16:31:00 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:00 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.info" returned: 0 in 0.257s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.988s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot e5a166fd-54e9-4f43-9987-38bb58e4acbe of volume c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199375d-dc34-4c58-b85f-3d95c31588c2]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-39a859d8-fc87-4264-b369-bcfd6d1f572e tempest-SnapshotDependencyTests-1088299858 None] Create snapshot completed successfully Sep 25 16:31:00 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 Sep 25 16:31:00 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:01 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:01 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe 1G Sep 25 16:31:01 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:01 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe 1G" returned: 0 in 0.435s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a807e-61f8-463e-8c89-2e139ea39526 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:01 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a807e-61f8-463e-8c89-2e139ea39526 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe Sep 25 16:31:01 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:01 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a807e-61f8-463e-8c89-2e139ea39526 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe" returned: 0 in 0.332s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:01 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe is being set with open permissions: ugo+rw Sep 25 16:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:02 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe Sep 25 16:31:02 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:02 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe" returned: 0 in 0.303s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:02 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info Sep 25 16:31:02 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Flow 'volume_create_manager' (72aca339-383f-4bea-911e-5516d75b1f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8f3b2-f697-495d-9865-d7ae88902504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8f3b2-f697-495d-9865-d7ae88902504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470c034664894c74b1c41124758031a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3e389ae-cc57-49b6-a755-d54097420aec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:02Z,use_quota=True,user_id='7604a59d2bef470389a6b59bb567c156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b68ebf-2241-4190-9fce-3b2d8e377930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b68ebf-2241-4190-9fce-3b2d8e377930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc13f10-9804-4604-bd87-e13942cb2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc13f10-9804-4604-bd87-e13942cb2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7', 'volume_name': 'volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7', 'volume_size': 1, 'snapshot_id': 'c3e389ae-cc57-49b6-a755-d54097420aec'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df294cb3-5688-4022-ae90-74397626d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df294cb3-5688-4022-ae90-74397626d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63e36ce-48bc-4a11-a19c-0a52f3a018b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Volume 8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7', 'volume_size': 1, 'snapshot_id': 'c3e389ae-cc57-49b6-a755-d54097420aec'} Sep 25 16:31:02 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info" returned: 0 in 0.327s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info is being set with open permissions: ugo+rw Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:02 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info Sep 25 16:31:02 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:02 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.info" returned: 0 in 0.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.370s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Creating volume 8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 from snapshot c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] snapshot: c3e389ae-cc57-49b6-a755-d54097420aec, volume: 8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:31:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c55514c4-c3f4-4788-bc27-8d395e9504e0 tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c8bff1-94b0-4bdb-a207-d0d46dbc0876]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (749d7df3-42df-4d26-b018-023b65647c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694d5948-09fe-417d-b5b3-a55c63cd4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694d5948-09fe-417d-b5b3-a55c63cd4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911422582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb5816d-6c60-489d-9f4c-3c70ceddb69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:03Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc841f40-d81a-4b49-911c-b386928e636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc841f40-d81a-4b49-911c-b386928e636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af39f5a-12f9-49ce-99c8-32e75be7ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af39f5a-12f9-49ce-99c8-32e75be7ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb5816d-6c60-489d-9f4c-3c70ceddb69f', 'volume_name': 'volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf3bdc7-883b-4fb0-93eb-c2167a7c9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf3bdc7-883b-4fb0-93eb-c2167a7c9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2581b742-5993-474a-bb9e-2bba171b47c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Volume cbb5816d-6c60-489d-9f4c-3c70ceddb69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f', 'volume_size': 1} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:03 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:31:03 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:03 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.392s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4438b40b-77ac-4356-be1e-0d1ee733cac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506a063-df15-4905-b8ca-f01ffeb4a66c]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:31:03 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:03 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.364s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Path /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:31:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 Sep 25 16:31:03 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-e5a166fd-54e9-4f43-9987-38bb58e4acbe-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-e5a166fd-54e9-4f43-9987-38bb58e4acbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-e5a166fd-54e9-4f43-9987-38bb58e4acbe" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-e5a166fd-54e9-4f43-9987-38bb58e4acbe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot e5a166fd-54e9-4f43-9987-38bb58e4acbe of volume c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d9ade-778f-4ed2-9b53-28b6ab7a59b7]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:04 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe Sep 25 16:31:04 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:04 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe" returned: 0 in 0.533s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15a807e-61f8-463e-8c89-2e139ea39526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2548b3bf-5881-4329-9bda-bed373571c6e]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:04 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 Sep 25 16:31:04 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:05 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526" returned: 0 in 0.510s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:05 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe Sep 25 16:31:05 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:05 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe" returned: 0 in 0.632s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:05 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe Sep 25 16:31:05 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:06 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:06 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:06 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526.e5a166fd-54e9-4f43-9987-38bb58e4acbe" returned: 0 in 0.460s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-e5a166fd-54e9-4f43-9987-38bb58e4acbe" released by "_delete_snapshot" :: held 2.323s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" released by "delete_snapshot" :: held 2.360s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Created reservations ['5b02f1ea-3b55-4e23-b55f-aad774295fb2', 'fe271464-8bbe-4200-b6fd-47230367a241', 'ae65ad1f-8e86-4c9c-b781-bc99e6ef4e19', 'e1f09ab8-58a9-4735-83f1-e1241b41c437'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:06 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.489s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:31:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-2e0645fe-2d4a-43b4-befe-5d2caee2c219 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-e5a166fd-54e9-4f43-9987-38bb58e4acbe-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-c15a807e-61f8-463e-8c89-2e139ea39526-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-c15a807e-61f8-463e-8c89-2e139ea39526-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff7e1c5-787b-45ac-aa73-41d310547bf5]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:07 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 Sep 25 16:31:07 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:08 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:08 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526 Sep 25 16:31:08 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:08 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c15a807e-61f8-463e-8c89-2e139ea39526" returned: 0 in 0.371s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c15a807e-61f8-463e-8c89-2e139ea39526" released by "delete_volume" :: held 1.180s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:10 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" returned: 0 in 6.492s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:31:10 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Converted 1024.00 MB image at 157.70 MB/s Sep 25 16:31:10 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 is being set with open permissions: ugo+rw Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Created reservations ['0521fe39-7fc5-4a28-af7b-c0c677a5f073', '258ece26-4a1f-493c-bc35-f817f4555fa4', '3ba3cfa3-fda7-4379-ad04-74130fcd4925', '22ab49b7-4116-4ea2-8577-e9cdd693177c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:10 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 Sep 25 16:31:10 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:10 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:10 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:10 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" returned: 0 in 0.290s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" released by "_copy_volume_from_snapshot" :: held 7.651s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" released by "_create_volume_from_snapshot" :: held 7.722s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.748s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.528s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911422582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb5816d-6c60-489d-9f4c-3c70ceddb69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:03Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Creating volume cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:10 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:10 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f 1073741824 Sep 25 16:31:10 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63e36ce-48bc-4a11-a19c-0a52f3a018b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7', 'volume_size': 1, 'snapshot_id': 'c3e389ae-cc57-49b6-a755-d54097420aec'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2aabad-12be-4d6b-9d6c-25f6c58f86d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Volume volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 (8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7): created successfully Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2aabad-12be-4d6b-9d6c-25f6c58f86d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:10 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Flow 'volume_create_manager' (72aca339-383f-4bea-911e-5516d75b1f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.296s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:31:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0ebe1137-9d5c-4cca-893b-afdc42786c61 tempest-SnapshotDependencyTests-1088299858 None] Created volume successfully. Sep 25 16:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12f81759-fec4-4316-9176-c3a7da5ebb70 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-c15a807e-61f8-463e-8c89-2e139ea39526-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:11 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f 1073741824" returned: 0 in 0.528s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:11 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f Sep 25 16:31:11 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-c3e389ae-cc57-49b6-a755-d54097420aec-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (04a84219-3a2d-4421-a0c1-296785f8b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8e1a48-d1f1-4df8-9aa6-b4b19f91a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-c3e389ae-cc57-49b6-a755-d54097420aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8e1a48-d1f1-4df8-9aa6-b4b19f91a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925085439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc28c843-571b-4bc3-92dc-827f1782238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:12Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fd71dc-3e8f-4322-8eb6-072f2ed2e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fd71dc-3e8f-4322-8eb6-072f2ed2e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764ab2be-d3b6-49e4-bcba-abded60fc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764ab2be-d3b6-49e4-bcba-abded60fc511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc28c843-571b-4bc3-92dc-827f1782238e', 'volume_name': 'volume-fc28c843-571b-4bc3-92dc-827f1782238e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21880f59-d4be-437d-930d-bbf65395a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21880f59-d4be-437d-930d-bbf65395a784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d9fa4e-a01c-4508-bebb-3c43359424a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Volume fc28c843-571b-4bc3-92dc-827f1782238e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc28c843-571b-4bc3-92dc-827f1782238e', 'volume_size': 1} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:11 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" returned: 0 in 0.322s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925085439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc28c843-571b-4bc3-92dc-827f1782238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:12Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Creating volume fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:11 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e 1073741824 Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2581b742-5993-474a-bb9e-2bba171b47c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969aca34-9453-43d6-9257-9d75bc240d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:11 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Deleting offline snapshot c3e389ae-cc57-49b6-a755-d54097420aec of volume 4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] snapshot_file for this snap is: volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Volume volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f (cbb5816d-6c60-489d-9f4c-3c70ceddb69f): created successfully Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969aca34-9453-43d6-9257-9d75bc240d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (749d7df3-42df-4d26-b018-023b65647c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[564af184-2cc6-49c1-a263-6e481b3b097b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4692a516-7dfb-4cd7-b2e8-2b5ba696e7e8 tempest-ProjectReaderTests-296435232 None] Created volume successfully. Sep 25 16:31:11 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:31:11 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:12 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e 1073741824" returned: 0 in 0.485s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:12 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.443s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4438b40b-77ac-4356-be1e-0d1ee733cac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:12 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e Sep 25 16:31:12 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f375a73d-c10f-439b-bc16-4acf818d8665]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:12 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:31:12 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:12 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e" returned: 0 in 0.287s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d9fa4e-a01c-4508-bebb-3c43359424a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc28c843-571b-4bc3-92dc-827f1782238e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb48d98-4e5a-4fde-a1ea-fa5faaa6e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Volume volume-fc28c843-571b-4bc3-92dc-827f1782238e (fc28c843-571b-4bc3-92dc-827f1782238e): created successfully Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb48d98-4e5a-4fde-a1ea-fa5faaa6e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (04a84219-3a2d-4421-a0c1-296785f8b16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-86eae1d0-6f55-451d-9c2e-735b7a07fcec tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:31:12 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.575s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:12 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:31:12 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:13 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.387s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:13 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec Sep 25 16:31:13 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Creating offline snapshot ae0d7c0a-0894-4135-81ef-125b80265ed8 of volume cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[494be9ea-7932-4f54-9c60-f0ebe0f24bb8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:13 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9.c3e389ae-cc57-49b6-a755-d54097420aec" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:13 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f Sep 25 16:31:13 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-c3e389ae-cc57-49b6-a755-d54097420aec" released by "_delete_snapshot" :: held 1.816s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" released by "delete_snapshot" :: held 1.880s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Created reservations ['b8fbfb24-9adf-4f27-86ad-3d35c7f17aa7', '5791810b-325b-4256-bb56-9b8697b70f47', 'a1bf3ae4-07c0-4512-8c83-769e3abbd103', 'bc8b765e-34f6-462a-9ca4-d8be0b99531a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Delete snapshot completed successfully. Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0cd91c35-6b49-4818-97b1-59b5ae076b17 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-c3e389ae-cc57-49b6-a755-d54097420aec-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:13 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" returned: 0 in 0.417s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:13 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 1G Sep 25 16:31:13 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:14 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 1G" returned: 0 in 0.403s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:14 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 Sep 25 16:31:14 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:14 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 is being set with open permissions: ugo+rw Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:14 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 Sep 25 16:31:14 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-4438b40b-77ac-4356-be1e-0d1ee733cac9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-4438b40b-77ac-4356-be1e-0d1ee733cac9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:14 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8" returned: 0 in 0.318s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d82376-f06a-40c7-a167-5220bd83adfb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:14 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info Sep 25 16:31:14 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:31:15 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info" returned: 0 in 0.336s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:15 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info is being set with open permissions: ugo+rw Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:15 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info Sep 25 16:31:15 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:15 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9 Sep 25 16:31:15 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.info" returned: 0 in 0.292s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.763s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 of volume fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:15 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4438b40b-77ac-4356-be1e-0d1ee733cac9" returned: 0 in 0.265s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822aee4-786a-4567-915e-ca2134728973]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bda4e0dc-83b9-4df3-949a-2ff760e4bd6f tempest-ProjectReaderTests-296435232 None] Create snapshot completed successfully Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-4438b40b-77ac-4356-be1e-0d1ee733cac9" released by "delete_volume" :: held 0.790s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Created reservations ['af1937e7-a248-43db-8009-0d666f194e0d', '981aeb93-a79f-4b01-927a-99e9cbb72854', '01bbf3bd-09ab-496d-9066-9d269d94d0c1', '197a9acd-5953-4e20-bf88-2b2a976e4e0c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:15 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e Sep 25 16:31:15 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:15 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:15 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:16 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e" returned: 0 in 0.458s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f38d1c-ec6f-4f1e-ae10-0fc000fb2427]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:16 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 1G Sep 25 16:31:16 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:16 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Deleted volume successfully. Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04076fde-25ab-48bf-bb86-0aca343a9395 tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-4438b40b-77ac-4356-be1e-0d1ee733cac9-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:16 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 Sep 25 16:31:16 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:16 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-ae0d7c0a-0894-4135-81ef-125b80265ed8-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" returned: 0 in 0.446s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:16 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7 Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-ae0d7c0a-0894-4135-81ef-125b80265ed8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:16 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-ae0d7c0a-0894-4135-81ef-125b80265ed8" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-ae0d7c0a-0894-4135-81ef-125b80265ed8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:16 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Deleting offline snapshot ae0d7c0a-0894-4135-81ef-125b80265ed8 of volume cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] snapshot_file for this snap is: volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 1G" returned: 0 in 0.598s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28c843-571b-4bc3-92dc-827f1782238e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d94d9-c05d-4e6b-94be-73ae652721e4]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:16 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28c843-571b-4bc3-92dc-827f1782238e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 Sep 25 16:31:16 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:16 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 Sep 25 16:31:16 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:16 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" returned: 0 in 0.333s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-quobyte-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7" released by "delete_volume" :: held 0.835s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Created reservations ['81592784-56c7-4520-b838-0dc1e7e7d69b', '3de2e7c9-7e3a-497b-b814-074d7276cc48', '3feca643-7946-45fa-ad0f-f511da8c2470', '3c98b62d-6543-406a-8368-9428547c227c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:17 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28c843-571b-4bc3-92dc-827f1782238e -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" returned: 0 in 0.401s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 is being set with open permissions: ugo+rw Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 Sep 25 16:31:17 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:17 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8" returned: 0 in 0.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:17 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:17 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b6e18-faa0-4ea5-a3f2-8785c613bbc7]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" returned: 0 in 0.384s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f Sep 25 16:31:17 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.366s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Deleted volume successfully. Sep 25 16:31:17 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info Sep 25 16:31:17 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-43290122-cd6e-4964-b19d-4a2d276649ab tempest-SnapshotDependencyTests-1088299858 None] Lock "cinder-8c0a2342-78b0-4ab2-9d6b-70d9f6c745f7-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:17 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" returned: 0 in 0.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 Sep 25 16:31:17 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:17 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info" returned: 0 in 0.344s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:17 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info is being set with open permissions: ugo+rw Sep 25 16:31:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:17 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info Sep 25 16:31:17 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:18 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.info" returned: 0 in 0.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:18 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8" returned: 0 in 0.410s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:18 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8 Sep 25 16:31:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e288bdb1-4f7a-450d-ac5d-cc71e189df2b tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:31:18 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:18 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f.ae0d7c0a-0894-4135-81ef-125b80265ed8" returned: 0 in 0.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-ae0d7c0a-0894-4135-81ef-125b80265ed8" released by "_delete_snapshot" :: held 1.859s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" released by "delete_snapshot" :: held 1.891s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Created reservations ['e827bfdf-f6bc-4f75-b42e-3b7c0efffbb0', '210ba67c-88e7-4fb0-b097-18d9cc9b662c', '119412f5-059c-4feb-b5f8-eb2b5deeb2df', '93927e4b-37f4-47ea-a872-03fd58044837'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Delete snapshot completed successfully. Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6ba0906f-f748-418b-a2e6-7086ffc6e1e3 tempest-ProjectReaderTests-296435232 None] Lock "cinder-ae0d7c0a-0894-4135-81ef-125b80265ed8-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-cbb5816d-6c60-489d-9f4c-3c70ceddb69f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "cinder-cbb5816d-6c60-489d-9f4c-3c70ceddb69f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff691c-4cb9-464b-b7e3-38ef1dc42967]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:19 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f Sep 25 16:31:19 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 of volume fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d647c95c-0481-455b-b9eb-ce872d65fccf]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:19 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" returned: 0 in 0.506s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:19 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 Sep 25 16:31:19 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:19 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f Sep 25 16:31:19 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:19 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:19 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" returned: 0 in 0.449s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc28c843-571b-4bc3-92dc-827f1782238e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-cbb5816d-6c60-489d-9f4c-3c70ceddb69f" released by "delete_volume" :: held 0.929s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c3ee5-b539-455f-9bd4-7bb968820a9f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:19 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e Sep 25 16:31:19 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:20 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e" returned: 0 in 0.390s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:20 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 Sep 25 16:31:20 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Created reservations ['477340ec-7c11-484b-b27c-82cc30e0d89b', 'e8ac7336-13bc-459b-ae17-ede32b62f1d4', '8bc8a359-8427-4ab0-bd9b-dd0b5a2bd5fe', 'cca392b5-72ff-482c-9fec-ca9c9dbb3f73'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:20 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" returned: 0 in 0.330s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:20 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018 Sep 25 16:31:20 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:20 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e.cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" returned: 0 in 0.246s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018" released by "_delete_snapshot" :: held 1.534s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" released by "delete_snapshot" :: held 1.566s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:23 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:23 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:23 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.236s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Deleted volume successfully. Sep 25 16:31:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8b0c831b-4a5c-4988-97cd-f211daccc818 tempest-ProjectReaderTests-296435232 None] Lock "cinder-cbb5816d-6c60-489d-9f4c-3c70ceddb69f-delete_volume" released by "delete_volume" :: held 6.392s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Created reservations ['eb8f99c9-74cb-42a8-952e-e331c863cbfb', '2c8b167f-e901-4c28-a424-7583a269bd1d', '5f576fd3-c389-4917-a2dc-439fc4bcbd62', '8f8b8733-966c-4787-ba7b-6dd920296807'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d37cab0-52c4-4302-ae79-412c06f8c3f8 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-cea048d3-ae4d-4ea7-8a3e-8b84d3fef018-delete_snapshot" released by "delete_snapshot" :: held 7.182s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-fc28c843-571b-4bc3-92dc-827f1782238e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-fc28c843-571b-4bc3-92dc-827f1782238e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31946d-52a2-4559-8fe3-4cbaa6f55fa1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (70f08614-880d-435a-acd0-525276478e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b63b1a-2c88-4815-a1eb-eefec3a7c8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b63b1a-2c88-4815-a1eb-eefec3a7c8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600722663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbd965e-e6e9-4d63-9edc-33b9bd0461f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:27Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67584f75-e798-4b12-b7b9-cdc5878b6581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67584f75-e798-4b12-b7b9-cdc5878b6581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6047547b-cc09-4a30-b767-52832d79403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6047547b-cc09-4a30-b767-52832d79403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbd965e-e6e9-4d63-9edc-33b9bd0461f0', 'volume_name': 'volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef962640-1f8b-44b5-b0eb-978810a475ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef962640-1f8b-44b5-b0eb-978810a475ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4462ff95-a69f-4ae2-895d-261d120cfb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Volume 4fbd965e-e6e9-4d63-9edc-33b9bd0461f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0', 'volume_size': 1} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600722663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbd965e-e6e9-4d63-9edc-33b9bd0461f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:27Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Creating volume 4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:27 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e Sep 25 16:31:27 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:27 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 1073741824 Sep 25 16:31:27 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:27 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e" returned: 0 in 0.454s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:27 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e Sep 25 16:31:27 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:27 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-fc28c843-571b-4bc3-92dc-827f1782238e" returned: 0 in 0.309s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:27 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 1073741824" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-fc28c843-571b-4bc3-92dc-827f1782238e" released by "delete_volume" :: held 0.865s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:27 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 Sep 25 16:31:27 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Created reservations ['8f7f5d00-9d4a-481d-9242-b733b591ce3e', '7fa7ef96-edde-4ea8-9bc5-339a397c68cb', 'b0435c61-2269-4496-ac6f-dd768f9228eb', '52c45c15-a2e2-412f-81b7-5dc4b61ec86e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:27 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:27 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:28 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" returned: 0 in 0.414s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4462ff95-a69f-4ae2-895d-261d120cfb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bc385a-13f6-4305-9d33-37bbc53f85f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Volume volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 (4fbd965e-e6e9-4d63-9edc-33b9bd0461f0): created successfully Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bc385a-13f6-4305-9d33-37bbc53f85f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (70f08614-880d-435a-acd0-525276478e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.363s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:31:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4bea8dd2-1c3c-4f4e-9298-c45db61a7785 tempest-ProjectReaderTests-296435232 None] Created volume successfully. Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6280146-7f52-4015-88b8-c1d6ac546c02 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-fc28c843-571b-4bc3-92dc-827f1782238e-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (595a8717-b8f5-4c9c-80b8-04994baa3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f2405-05fe-4ccc-b5bb-b8435fea88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f2405-05fe-4ccc-b5bb-b8435fea88a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321673080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b1d82b-fc98-422b-b6e5-19a26e890880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:28Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a57179-65a3-49ef-84a1-c51428ca87a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a57179-65a3-49ef-84a1-c51428ca87a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dfc073-b3c7-46e4-9298-59c77c24c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dfc073-b3c7-46e4-9298-59c77c24c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b1d82b-fc98-422b-b6e5-19a26e890880', 'volume_name': 'volume-60b1d82b-fc98-422b-b6e5-19a26e890880', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae8cda7-3863-4edb-b6ec-b6d83dc8d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae8cda7-3863-4edb-b6ec-b6d83dc8d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1108f8-c6b9-4370-a18d-8c9981bd8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Volume 60b1d82b-fc98-422b-b6e5-19a26e890880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b1d82b-fc98-422b-b6e5-19a26e890880', 'volume_size': 1} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321673080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b1d82b-fc98-422b-b6e5-19a26e890880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:28Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Creating volume 60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:28 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 1073741824 Sep 25 16:31:28 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:29 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 1073741824" returned: 0 in 0.516s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:29 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 Sep 25 16:31:29 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:29 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880" returned: 0 in 0.233s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1108f8-c6b9-4370-a18d-8c9981bd8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b1d82b-fc98-422b-b6e5-19a26e890880', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcecde04-f659-4a1d-a2c0-780b9b91c9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Creating offline snapshot 2c28c42c-7319-4f5c-b2f9-15b2eb17859c of volume 4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Volume volume-60b1d82b-fc98-422b-b6e5-19a26e890880 (60b1d82b-fc98-422b-b6e5-19a26e890880): created successfully Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcecde04-f659-4a1d-a2c0-780b9b91c9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (595a8717-b8f5-4c9c-80b8-04994baa3257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218c951-c438-4973-8000-137018de9690]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3d182c9b-4329-43ea-89bf-039dd8051c4b tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:31:29 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 Sep 25 16:31:29 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:29 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" returned: 0 in 0.400s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:29 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c 1G Sep 25 16:31:29 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:30 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c 1G" returned: 0 in 0.416s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:30 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c Sep 25 16:31:30 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:30 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c" returned: 0 in 0.358s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:30 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c is being set with open permissions: ugo+rw Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:30 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c Sep 25 16:31:30 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:30 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c" returned: 0 in 0.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:31 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info Sep 25 16:31:31 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:31 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info" returned: 0 in 0.282s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:31 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info is being set with open permissions: ugo+rw Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:31 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info Sep 25 16:31:31 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:31 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.info" returned: 0 in 0.245s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot 8584c55d-4bb4-401a-8d58-9d739190f140 of volume 60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4c17f313-ed5d-4296-a344-cf81fa871ed7 tempest-ProjectReaderTests-296435232 None] Create snapshot completed successfully Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d92e51-56be-43bb-82d1-9accc2275398]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:31 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 Sep 25 16:31:31 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:31 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880" returned: 0 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:31 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 1G Sep 25 16:31:31 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-2c28c42c-7319-4f5c-b2f9-15b2eb17859c-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-2c28c42c-7319-4f5c-b2f9-15b2eb17859c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-2c28c42c-7319-4f5c-b2f9-15b2eb17859c" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-2c28c42c-7319-4f5c-b2f9-15b2eb17859c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Deleting offline snapshot 2c28c42c-7319-4f5c-b2f9-15b2eb17859c of volume 4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] snapshot_file for this snap is: volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[deefba18-7582-44aa-9f52-a6e5e1f385e9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:32 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c Sep 25 16:31:32 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:32 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 1G" returned: 0 in 0.632s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b1d82b-fc98-422b-b6e5-19a26e890880 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:32 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b1d82b-fc98-422b-b6e5-19a26e890880 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 Sep 25 16:31:32 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:32 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c" returned: 0 in 0.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:32 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b1d82b-fc98-422b-b6e5-19a26e890880 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140" returned: 0 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 is being set with open permissions: ugo+rw Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[52216290-88a6-4c28-b4ae-689a43af895f]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:32 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 Sep 25 16:31:32 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 Sep 25 16:31:33 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140" returned: 0 in 0.290s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:33 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info Sep 25 16:31:33 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" returned: 0 in 0.477s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:33 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c Sep 25 16:31:33 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info" returned: 0 in 0.320s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:33 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info is being set with open permissions: ugo+rw Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:33 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info Sep 25 16:31:33 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.info" returned: 0 in 0.273s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:33 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c" returned: 0 in 0.455s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:33 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c Sep 25 16:31:33 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-45f26dcb-f16d-4698-9d56-4c88f2dac9cd tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-8584c55d-4bb4-401a-8d58-9d739190f140-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-8584c55d-4bb4-401a-8d58-9d739190f140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-8584c55d-4bb4-401a-8d58-9d739190f140" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-8584c55d-4bb4-401a-8d58-9d739190f140" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot 8584c55d-4bb4-401a-8d58-9d739190f140 of volume 60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:34 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0.2c28c42c-7319-4f5c-b2f9-15b2eb17859c" returned: 0 in 0.314s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[568545a9-97c9-4d72-baf5-c6a2aab6f270]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-2c28c42c-7319-4f5c-b2f9-15b2eb17859c" released by "_delete_snapshot" :: held 1.861s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" released by "delete_snapshot" :: held 1.898s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Created reservations ['44a1f157-57da-4329-aa21-03d7c8b83d91', '58b9f6b6-f394-45b5-9098-2fab202eb608', 'dbc30132-4862-4e82-a32a-11cfec442b13', 'bb73ee08-72c4-4cbe-a3fb-08e42786ada5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:34 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 Sep 25 16:31:34 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Delete snapshot completed successfully. Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-45e3fe15-0f4c-4227-993f-5185a66b46df tempest-ProjectReaderTests-296435232 None] Lock "cinder-2c28c42c-7319-4f5c-b2f9-15b2eb17859c-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "cinder-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bc3ba4-a736-4d05-95c5-039b17d6fdcf]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:34 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140" returned: 0 in 0.517s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b1d82b-fc98-422b-b6e5-19a26e890880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8d0f2-5679-49e7-af25-5113941a4ee9]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:34 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 Sep 25 16:31:34 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:34 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 Sep 25 16:31:34 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:35 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" returned: 0 in 0.405s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:35 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0 Sep 25 16:31:35 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:35 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880" returned: 0 in 0.439s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:35 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 Sep 25 16:31:35 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:35 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" returned: 0 in 0.325s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0" released by "delete_volume" :: held 0.828s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Created reservations ['11fca825-6011-4880-a245-3bcfae94bd09', '8957d799-fc3c-4815-8cbc-9c96fb121de4', '7e834295-6c54-45af-9970-dfd3b8d62367', 'ba96e6bd-e30d-441d-a25f-dfede33512fe'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:35 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:35 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:35 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140" returned: 0 in 0.503s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:35 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140 Sep 25 16:31:35 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:35 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.315s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:35 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Deleted volume successfully. Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dcb484b1-eb33-41a9-a8b3-6dd669c7442d tempest-ProjectReaderTests-296435232 None] Lock "cinder-4fbd965e-e6e9-4d63-9edc-33b9bd0461f0-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:36 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880.8584c55d-4bb4-401a-8d58-9d739190f140" returned: 0 in 0.350s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-8584c55d-4bb4-401a-8d58-9d739190f140" released by "_delete_snapshot" :: held 1.960s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" released by "delete_snapshot" :: held 1.989s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Created reservations ['772d7fb6-82bb-436f-8b42-f28e57431466', 'e70b0c93-2e30-4900-963b-451e93c52539', '8fb5d32e-8d5a-4f2a-a954-fb2da2a9c1f7', 'c47768a6-c90e-4a1d-ad06-158ee4192e86'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0dfa9987-91ae-441b-9697-919b6cd31c4a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-8584c55d-4bb4-401a-8d58-9d739190f140-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (960108b8-858d-48dd-8f2b-6a22b0eeea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f25f7f-ab0f-42d5-aed1-0e7dfd98771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f25f7f-ab0f-42d5-aed1-0e7dfd98771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192808039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:36Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00443a93-78a4-4325-af41-620789b3f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00443a93-78a4-4325-af41-620789b3f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faff1f77-96a5-4750-8e8b-d822601cacbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faff1f77-96a5-4750-8e8b-d822601cacbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45', 'volume_name': 'volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a4073c-f4ed-4424-a39f-33ebf3f8e5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a4073c-f4ed-4424-a39f-33ebf3f8e5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab49baa-2aec-4e03-9afe-7c086f89e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Volume a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45', 'volume_size': 1} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192808039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:36Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Creating volume a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:36 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 1073741824 Sep 25 16:31:36 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:36 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 1073741824" returned: 0 in 0.425s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:36 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 Sep 25 16:31:36 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:37 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" returned: 0 in 0.229s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab49baa-2aec-4e03-9afe-7c086f89e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17edd5e3-a49f-44ca-a0ae-3afcfbea8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Volume volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 (a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45): created successfully Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17edd5e3-a49f-44ca-a0ae-3afcfbea8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (960108b8-858d-48dd-8f2b-6a22b0eeea0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-25fb1811-4dc8-477d-bf5c-518bf80366b1 tempest-ProjectReaderTests-296435232 None] Created volume successfully. Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-60b1d82b-fc98-422b-b6e5-19a26e890880-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-60b1d82b-fc98-422b-b6e5-19a26e890880-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc1527-d9bc-46fb-ab2d-01799e67afed]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:37 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 Sep 25 16:31:37 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Creating offline snapshot b419685c-1f24-4fe7-b706-b174c2725cb7 of volume a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee247e-a779-4f8c-af8e-f8aaf170d1ff]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:37 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880" returned: 0 in 0.369s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:37 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880 Sep 25 16:31:37 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:37 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 Sep 25 16:31:37 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:38 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-60b1d82b-fc98-422b-b6e5-19a26e890880" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-60b1d82b-fc98-422b-b6e5-19a26e890880" released by "delete_volume" :: held 0.681s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Created reservations ['aa55adef-a9db-41a3-ab85-fbd1ae86a1c0', '81a0a5a0-77df-4df0-9959-30c8e381cda6', '096e0bcb-bdf7-4888-b777-e6564ac3603c', 'fbc8d0d9-c53d-4a9b-af62-f27d3397265b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:38 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" returned: 0 in 0.386s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:38 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 1G Sep 25 16:31:38 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:38 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:38 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:38 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.264s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=176,cinder:INSERT=64,cinder:DELETE=18,cinder:UPDATE=233 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-28e856d7-efe6-4aab-a8aa-abfd0d04780a tempest-ProjectMemberTests-2117812452 None] Lock "cinder-60b1d82b-fc98-422b-b6e5-19a26e890880-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:38 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 1G" returned: 0 in 0.461s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:38 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 Sep 25 16:31:38 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=187,cinder:UPDATE=250,cinder:INSERT=66,cinder:DELETE=21 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (a78cc678-3390-4d9b-90a4-321458bc2899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab4c85-bf9e-4933-b341-3cb2cc0f4eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab4c85-bf9e-4933-b341-3cb2cc0f4eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199914900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41d02dd-7cdc-4b51-ae8b-6579deba7ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:39Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a806e196-48cb-4a8f-91d1-9f303b7bef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a806e196-48cb-4a8f-91d1-9f303b7bef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:39 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e838fd-4e65-478a-8f86-08ca92339bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e838fd-4e65-478a-8f86-08ca92339bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41d02dd-7cdc-4b51-ae8b-6579deba7ec5', 'volume_name': 'volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fc4ae6-d4b5-4113-856d-2543c2b99a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fc4ae6-d4b5-4113-856d-2543c2b99a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b62505-d1c7-4ca6-bbda-a2a5135cf741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Volume c41d02dd-7cdc-4b51-ae8b-6579deba7ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5', 'volume_size': 1} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7" returned: 0 in 0.338s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:39 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 is being set with open permissions: ugo+rw Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:39 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 Sep 25 16:31:39 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:39 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7" returned: 0 in 0.246s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:39 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info Sep 25 16:31:39 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:39 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info" returned: 0 in 0.248s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:39 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info is being set with open permissions: ugo+rw Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:39 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info Sep 25 16:31:39 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:39 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.info" returned: 0 in 0.231s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199914900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41d02dd-7cdc-4b51-ae8b-6579deba7ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5943117173f4a1fb8e4f1f13b637198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:39Z,use_quota=True,user_id='946f2debf549472399637889856e1205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Creating volume c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:39 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 1073741824 Sep 25 16:31:39 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8a191e35-51e5-45e2-aa82-d008647b9ea4 tempest-ProjectReaderTests-296435232 None] Create snapshot completed successfully Sep 25 16:31:40 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 1073741824" returned: 0 in 0.406s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:40 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 Sep 25 16:31:40 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:40 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" returned: 0 in 0.240s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b62505-d1c7-4ca6-bbda-a2a5135cf741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cb4233-4705-4dbc-8d52-10fb4686638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Volume volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 (c41d02dd-7cdc-4b51-ae8b-6579deba7ec5): created successfully Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cb4233-4705-4dbc-8d52-10fb4686638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Flow 'volume_create_manager' (a78cc678-3390-4d9b-90a4-321458bc2899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4110cc48-c78c-4eb4-8e4a-27d5f55464d0 tempest-ProjectMemberTests-2117812452 None] Created volume successfully. Sep 25 16:31:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-b419685c-1f24-4fe7-b706-b174c2725cb7-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-b419685c-1f24-4fe7-b706-b174c2725cb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-b419685c-1f24-4fe7-b706-b174c2725cb7" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-b419685c-1f24-4fe7-b706-b174c2725cb7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Deleting offline snapshot b419685c-1f24-4fe7-b706-b174c2725cb7 of volume a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] snapshot_file for this snap is: volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7784a6-607e-4cb9-b79e-b92f4bc7b616]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:41 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 Sep 25 16:31:41 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Creating offline snapshot cae46e69-e8e6-498d-8236-af6717e58d93 of volume c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e9a07-c219-4c8e-9716-565c675d3a0a]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:41 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 Sep 25 16:31:41 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:41 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7" returned: 0 in 0.373s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ec898-7bd4-40df-bad1-d89aea9c6fbc]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:41 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 Sep 25 16:31:41 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:41 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" returned: 0 in 0.389s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:41 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 1G Sep 25 16:31:41 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:41 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" returned: 0 in 0.372s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:41 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 Sep 25 16:31:41 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:42 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 1G" returned: 0 in 0.440s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:42 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 Sep 25 16:31:42 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:42 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7" returned: 0 in 0.349s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:42 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7 Sep 25 16:31:42 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:42 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93" returned: 0 in 0.304s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 is being set with open permissions: ugo+rw Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:42 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 Sep 25 16:31:42 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:42 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45.b419685c-1f24-4fe7-b706-b174c2725cb7" returned: 0 in 0.250s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-b419685c-1f24-4fe7-b706-b174c2725cb7" released by "_delete_snapshot" :: held 1.467s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" released by "delete_snapshot" :: held 1.489s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Created reservations ['1ab9f57e-d19e-4b78-b7d3-e746bd86da24', '14849080-9cbf-416c-acb0-84838e8b9ecb', 'c6f5403d-bb68-4d77-8967-8f6d02c11005', 'd7eddb5c-583d-44c1-bf33-9a224a224864'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Delete snapshot completed successfully. Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-30c09c76-0258-49c9-b7ec-621a0f51056a tempest-ProjectReaderTests-296435232 None] Lock "cinder-b419685c-1f24-4fe7-b706-b174c2725cb7-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:42 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:42 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info Sep 25 16:31:42 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:42 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info" returned: 0 in 0.238s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:42 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info is being set with open permissions: ugo+rw Sep 25 16:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:42 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info Sep 25 16:31:42 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:43 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.info" returned: 0 in 0.235s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "cinder-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-381eb74e-2d19-4b37-883d-666fb4d0e6ac tempest-ProjectMemberTests-2117812452 None] Create snapshot completed successfully Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f1332-439c-458d-bc2a-9ebc1b0f3ab6]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:43 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 Sep 25 16:31:43 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-cae46e69-e8e6-498d-8236-af6717e58d93-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-cae46e69-e8e6-498d-8236-af6717e58d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-cae46e69-e8e6-498d-8236-af6717e58d93" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-cae46e69-e8e6-498d-8236-af6717e58d93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Deleting offline snapshot cae46e69-e8e6-498d-8236-af6717e58d93 of volume c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] snapshot_file for this snap is: volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a5199-d993-41f1-9844-7ca73c8bd8d8]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:43 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 Sep 25 16:31:43 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:43 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:43 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45 Sep 25 16:31:43 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:43 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93" returned: 0 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:43 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" returned: 0 in 0.251s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[855d55f8-7ed9-4934-9312-498f35a864fb]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45" released by "delete_volume" :: held 0.713s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Created reservations ['7facde93-7349-4aa4-abb4-6407114a2c3e', '762a75f0-4ae8-43ed-8ae5-d8ac373162b7', 'ed1ad2f7-61cd-4c7b-b08f-08354625256f', '43d8ce1f-7323-42bc-ab8b-8715a02200fc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:44 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 Sep 25 16:31:44 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:44 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:44 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:44 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:44 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.253s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" returned: 0 in 0.382s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Deleted volume successfully. Sep 25 16:31:44 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 Sep 25 16:31:44 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f280e8b3-17e6-4342-a536-af500ac9e7e2 tempest-ProjectReaderTests-296435232 None] Lock "cinder-a2fd1e18-9b1c-4bd5-9d3e-06138ac7bb45-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:44 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93" returned: 0 in 0.356s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:44 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93 Sep 25 16:31:44 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (73b235cc-986c-4284-baec-6c9654a39c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae9b0ca-7c34-4071-b0c6-34e6f50bc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae9b0ca-7c34-4071-b0c6-34e6f50bc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954794692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3ea78b-8f06-4cfe-b5f7-dc2b298af441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:45Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55672b8-4718-43c8-adab-7e3f72d98dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55672b8-4718-43c8-adab-7e3f72d98dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e224aa2b-e89b-409b-9dda-adcbf7ae7868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e224aa2b-e89b-409b-9dda-adcbf7ae7868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3ea78b-8f06-4cfe-b5f7-dc2b298af441', 'volume_name': 'volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219e6e0-3e0d-44d7-a160-290041c34308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219e6e0-3e0d-44d7-a160-290041c34308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23054bf-7dbe-4dde-a162-0428b64083f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Volume 7e3ea78b-8f06-4cfe-b5f7-dc2b298af441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441', 'volume_size': 1} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954794692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3ea78b-8f06-4cfe-b5f7-dc2b298af441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:45Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Creating volume 7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:44 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 1073741824 Sep 25 16:31:44 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:44 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5.cae46e69-e8e6-498d-8236-af6717e58d93" returned: 0 in 0.241s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-cae46e69-e8e6-498d-8236-af6717e58d93" released by "_delete_snapshot" :: held 1.436s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" released by "delete_snapshot" :: held 1.464s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Created reservations ['6cd987ae-621b-4dbc-a783-709623fd5897', '5b906ee1-853e-46c0-b39a-4ed9a084f7bd', '176baaf9-18c1-44f6-bf29-311fc5fa8a80', '559373ac-cbf8-4a1a-a051-6e05c108d4f2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Delete snapshot completed successfully. Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cb86166c-f53a-4761-8465-4fd80c01a5c6 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-cae46e69-e8e6-498d-8236-af6717e58d93-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:45 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 1073741824" returned: 0 in 0.400s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:45 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 Sep 25 16:31:45 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:45 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" returned: 0 in 0.242s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23054bf-7dbe-4dde-a162-0428b64083f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e14f22-cc11-4baa-967d-d06c67480f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Volume volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 (7e3ea78b-8f06-4cfe-b5f7-dc2b298af441): created successfully Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e14f22-cc11-4baa-967d-d06c67480f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (73b235cc-986c-4284-baec-6c9654a39c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a672a787-bbf0-4f7a-85c4-fb7e7951f966 tempest-ProjectReaderTests-296435232 None] Created volume successfully. Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[25edd61e-0fa0-42f6-918d-60addc736203]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:45 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 Sep 25 16:31:45 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Creating offline snapshot 0c65839d-63e1-4c72-887c-5aa53f9819b6 of volume 7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdbc208-2985-4fa2-a48c-d5728dc5f0ae]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:46 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 Sep 25 16:31:46 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:46 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" returned: 0 in 0.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:46 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5 Sep 25 16:31:46 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:46 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" returned: 0 in 0.233s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:46 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" returned: 0 in 0.366s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-quobyte-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5" released by "delete_volume" :: held 0.661s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:46 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 1G Sep 25 16:31:46 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Created reservations ['bcd7fb56-3565-48c5-bf06-aee098e7ac64', '9f3e3ab0-4fa4-4996-9008-f667601d88cd', 'cb016e1a-af30-4858-922a-300058f8adc2', '8d5efd32-433d-401d-9c0d-93082c4778a4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:46 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:46 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:46 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.247s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Deleted volume successfully. Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-12d48661-8f0c-4694-99fe-cbf7f35ab702 tempest-ProjectMemberTests-2117812452 None] Lock "cinder-c41d02dd-7cdc-4b51-ae8b-6579deba7ec5-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:46 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 1G" returned: 0 in 0.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:46 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 Sep 25 16:31:46 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:47 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6" returned: 0 in 0.294s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:47 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 is being set with open permissions: ugo+rw Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:47 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 Sep 25 16:31:47 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:47 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6" returned: 0 in 0.243s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:47 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info Sep 25 16:31:47 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:47 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info" returned: 0 in 0.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:47 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info is being set with open permissions: ugo+rw Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:47 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info Sep 25 16:31:47 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:47 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.info" returned: 0 in 0.264s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-32b16bcf-5e38-4660-a8c0-30f8e575548f tempest-ProjectReaderTests-296435232 None] Create snapshot completed successfully Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-0c65839d-63e1-4c72-887c-5aa53f9819b6-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-0c65839d-63e1-4c72-887c-5aa53f9819b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-0c65839d-63e1-4c72-887c-5aa53f9819b6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-0c65839d-63e1-4c72-887c-5aa53f9819b6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Deleting offline snapshot 0c65839d-63e1-4c72-887c-5aa53f9819b6 of volume 7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] snapshot_file for this snap is: volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acece5-dd5f-4549-82f7-42c22711616b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:48 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 Sep 25 16:31:48 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:48 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6" returned: 0 in 0.375s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f1ef4-0293-4c2e-939b-4f6e0af76c32]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:48 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 Sep 25 16:31:48 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:48 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" returned: 0 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:48 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 Sep 25 16:31:48 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:49 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6" returned: 0 in 0.357s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:49 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6 Sep 25 16:31:49 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:49 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441.0c65839d-63e1-4c72-887c-5aa53f9819b6" returned: 0 in 0.263s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-0c65839d-63e1-4c72-887c-5aa53f9819b6" released by "_delete_snapshot" :: held 1.448s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" released by "delete_snapshot" :: held 1.473s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Created reservations ['6bf4630b-50eb-406d-933b-0e00ba001e5e', '255f049e-4c4f-4295-8f63-edea03c8d12c', 'fd3c50e4-dda8-4b8a-a704-a8a3071df24e', '35ffc98f-4b47-4dc4-b48f-ffd9c8df0056'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Delete snapshot completed successfully. Sep 25 16:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26325b2b-9d30-48bf-9d88-b34aba23f06a tempest-ProjectReaderTests-296435232 None] Lock "cinder-0c65839d-63e1-4c72-887c-5aa53f9819b6-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "cinder-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3b2cb-7e13-49ab-9e49-11faf44adc6d]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (5614137d-c698-4648-b8f5-0852049b2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:50 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 Sep 25 16:31:50 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f361a41-eccc-465b-acd6-207d82568148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f361a41-eccc-465b-acd6-207d82568148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197765711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fab8f6-fcee-4540-8762-ee90301e2ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:50Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29c87d6-586a-4201-928d-5edf6b928310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29c87d6-586a-4201-928d-5edf6b928310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979422e-c71d-41d2-a5ef-1e4023f0faea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e979422e-c71d-41d2-a5ef-1e4023f0faea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fab8f6-fcee-4540-8762-ee90301e2ebc', 'volume_name': 'volume-28fab8f6-fcee-4540-8762-ee90301e2ebc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f4f51a-050a-478e-bc75-08838524ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f4f51a-050a-478e-bc75-08838524ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b85178-f8d2-40c4-b841-6e963969d0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Volume 28fab8f6-fcee-4540-8762-ee90301e2ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fab8f6-fcee-4540-8762-ee90301e2ebc', 'volume_size': 1} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197765711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fab8f6-fcee-4540-8762-ee90301e2ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:50Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Creating volume 28fab8f6-fcee-4540-8762-ee90301e2ebc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:50 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc 1073741824 Sep 25 16:31:50 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:50 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" returned: 0 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:50 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441 Sep 25 16:31:50 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:51 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc 1073741824" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:51 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" returned: 0 in 0.265s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441" released by "delete_volume" :: held 0.718s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:51 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc Sep 25 16:31:51 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Created reservations ['c9c993d5-5590-4867-9344-52a70676280e', '77a65a5a-8287-409d-9ce6-740a4a25d5ac', '01a07159-c216-4933-8ab5-5bc3f976488f', 'a5dd1d3f-a71c-4d38-b3c5-767b5c125147'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:51 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:51 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:51 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc" returned: 0 in 0.273s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b85178-f8d2-40c4-b841-6e963969d0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fab8f6-fcee-4540-8762-ee90301e2ebc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f45d2a-76b4-4866-b68d-f6377afaca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Volume volume-28fab8f6-fcee-4540-8762-ee90301e2ebc (28fab8f6-fcee-4540-8762-ee90301e2ebc): created successfully Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f45d2a-76b4-4866-b68d-f6377afaca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (5614137d-c698-4648-b8f5-0852049b2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-833e6690-68be-4e5d-8b77-dd4e03b64e28 tempest-ProjectReaderTests-1881910728 None] Created volume successfully. Sep 25 16:31:51 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.303s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Deleted volume successfully. Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c737528e-3f53-48fc-9799-f69bf86c3a38 tempest-ProjectReaderTests-296435232 None] Lock "cinder-7e3ea78b-8f06-4cfe-b5f7-dc2b298af441-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (b1ce52e6-8358-4acf-addc-b21dbf747b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad32334a-bf2d-47e6-9c24-92b3f5406502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad32334a-bf2d-47e6-9c24-92b3f5406502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823021699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:52Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35052594-3f08-4f53-9e3e-04bca29ab8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35052594-3f08-4f53-9e3e-04bca29ab8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254446e5-3178-43fb-a232-eee19bcc44b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254446e5-3178-43fb-a232-eee19bcc44b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce', 'volume_name': 'volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ca5690-5f86-4c52-8b23-445eba7cc666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ca5690-5f86-4c52-8b23-445eba7cc666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ed947-2c2b-4092-9020-34ada0bb5c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Volume bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce', 'volume_size': 1} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823021699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bd7a133c284db3963c1c139124d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:52Z,use_quota=True,user_id='e9b92d2d69c740b499304c537aaad2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Creating volume bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:52 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:52 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce 1073741824 Sep 25 16:31:52 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:52 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce 1073741824" returned: 0 in 0.436s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:52 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce Sep 25 16:31:52 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:52 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" returned: 0 in 0.297s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-28fab8f6-fcee-4540-8762-ee90301e2ebc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ed947-2c2b-4092-9020-34ada0bb5c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c517a0e3-782d-4be4-b27c-c1f28d5579c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Volume volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce (bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce): created successfully Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c517a0e3-782d-4be4-b27c-c1f28d5579c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Flow 'volume_create_manager' (b1ce52e6-8358-4acf-addc-b21dbf747b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "cinder-28fab8f6-fcee-4540-8762-ee90301e2ebc-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c15424ce-d091-4f2a-96a4-0a64db8ab776 tempest-ProjectReaderTests-296435232 None] Created volume successfully. Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-quobyte-28fab8f6-fcee-4540-8762-ee90301e2ebc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-28fab8f6-fcee-4540-8762-ee90301e2ebc" acquired by "delete_volume" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb053ad2-f2b8-46e2-a496-a2dcea2fea19]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:53 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc Sep 25 16:31:53 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:53 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc" returned: 0 in 0.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:53 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc Sep 25 16:31:53 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:53 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-28fab8f6-fcee-4540-8762-ee90301e2ebc" returned: 0 in 0.241s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-28fab8f6-fcee-4540-8762-ee90301e2ebc" released by "delete_volume" :: held 0.646s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Created reservations ['c679b464-cff3-4d70-9d0c-b9c9b8b70e8f', '436eb1a8-070d-42d0-9498-fa444880e7cd', '1d76f267-0ac3-4ca3-8f80-5b908139b926', 'cd3cf69c-b04d-4801-886d-f2567948c6e7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:53 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:53 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:54 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.269s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Deleted volume successfully. Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98dfe1bb-79f3-492a-a8cd-404e06d9bbbb tempest-ProjectReaderTests-1881910728 None] Lock "cinder-28fab8f6-fcee-4540-8762-ee90301e2ebc-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Creating offline snapshot 55ec357d-273b-4ba8-b471-0d2f5a71126c of volume bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b605a57-1bbb-4507-b839-3ab19b3ac3fd]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:54 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce Sep 25 16:31:54 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (bd10b384-3fec-4aeb-b2e9-b39dd4544906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3abc520-4f6d-4d4b-b4d1-9d27f1feb253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3abc520-4f6d-4d4b-b4d1-9d27f1feb253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727185796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125c08-71c0-4409-b3b6-888897271538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:55Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417e9693-f3a4-4712-ba1f-4272181c5033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417e9693-f3a4-4712-ba1f-4272181c5033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e286a-01f4-40a2-a01f-6c40ad439204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e286a-01f4-40a2-a01f-6c40ad439204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67125c08-71c0-4409-b3b6-888897271538', 'volume_name': 'volume-67125c08-71c0-4409-b3b6-888897271538', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507c28d0-24a6-4180-87ab-fc09bf15942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507c28d0-24a6-4180-87ab-fc09bf15942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab68530-c209-4179-a65f-9f904c74437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Volume 67125c08-71c0-4409-b3b6-888897271538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67125c08-71c0-4409-b3b6-888897271538', 'volume_size': 1} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:54 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" returned: 0 in 0.406s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:54 devstack sudo[109914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c 1G Sep 25 16:31:54 devstack sudo[109914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:55 devstack sudo[109914]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c 1G" returned: 0 in 0.408s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:55 devstack sudo[109919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c Sep 25 16:31:55 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:55 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce -F qcow2 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c" returned: 0 in 0.292s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c is being set with open permissions: ugo+rw Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:55 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c Sep 25 16:31:55 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:55 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c" returned: 0 in 0.253s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:55 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info Sep 25 16:31:55 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:55 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info" returned: 0 in 0.248s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info is being set with open permissions: ugo+rw Sep 25 16:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:55 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info Sep 25 16:31:55 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:56 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.info" returned: 0 in 0.227s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727185796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125c08-71c0-4409-b3b6-888897271538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:55Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Creating volume 67125c08-71c0-4409-b3b6-888897271538 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:56 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 1073741824 Sep 25 16:31:56 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ebc16248-d966-4723-bfc0-c325abfc20e0 tempest-ProjectReaderTests-296435232 None] Create snapshot completed successfully Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-55ec357d-273b-4ba8-b471-0d2f5a71126c-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-55ec357d-273b-4ba8-b471-0d2f5a71126c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-55ec357d-273b-4ba8-b471-0d2f5a71126c" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-55ec357d-273b-4ba8-b471-0d2f5a71126c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Deleting offline snapshot 55ec357d-273b-4ba8-b471-0d2f5a71126c of volume bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] snapshot_file for this snap is: volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b59cdf-f42c-409e-a215-19d0af579216]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:56 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c Sep 25 16:31:56 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:56 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 1073741824" returned: 0 in 0.500s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:56 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 Sep 25 16:31:56 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:56 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c" returned: 0 in 0.364s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[39220c46-5f23-4b6b-b0a3-800e29ecff33]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:57 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538" returned: 0 in 0.255s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab68530-c209-4179-a65f-9f904c74437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67125c08-71c0-4409-b3b6-888897271538', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080716a-0262-42a8-9108-2cd89cceefb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:57 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce Sep 25 16:31:57 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Volume volume-67125c08-71c0-4409-b3b6-888897271538 (67125c08-71c0-4409-b3b6-888897271538): created successfully Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080716a-0262-42a8-9108-2cd89cceefb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (bd10b384-3fec-4aeb-b2e9-b39dd4544906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d698323-3397-4bdb-aa91-3b6d1c0b1272 tempest-ProjectReaderTests-1881910728 None] Created volume successfully. Sep 25 16:31:57 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" returned: 0 in 0.345s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:57 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c Sep 25 16:31:57 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:57 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c" returned: 0 in 0.326s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:57 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c Sep 25 16:31:57 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-67125c08-71c0-4409-b3b6-888897271538-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-67125c08-71c0-4409-b3b6-888897271538-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-quobyte-67125c08-71c0-4409-b3b6-888897271538" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-67125c08-71c0-4409-b3b6-888897271538" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:57 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce.55ec357d-273b-4ba8-b471-0d2f5a71126c" returned: 0 in 0.261s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b43c2-f293-4b60-83b9-ad14021e8a02]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-55ec357d-273b-4ba8-b471-0d2f5a71126c" released by "_delete_snapshot" :: held 1.408s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" released by "delete_snapshot" :: held 1.444s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Created reservations ['83126c00-e448-4c23-8838-4539abd828c7', '3a2d29a4-0fc2-4e85-89d7-7e8668bdf3f3', 'fbc74540-4e61-49f2-b0b4-441c1fdf42af', '07128b0c-a84a-445b-8630-23a87b2bf13b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:58 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 Sep 25 16:31:58 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Delete snapshot completed successfully. Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-990e95c8-b1ec-489a-94f7-177cc0eb0453 tempest-ProjectReaderTests-296435232 None] Lock "cinder-55ec357d-273b-4ba8-b471-0d2f5a71126c-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:58 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538" returned: 0 in 0.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:58 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538 Sep 25 16:31:58 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:58 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-67125c08-71c0-4409-b3b6-888897271538" returned: 0 in 0.248s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-67125c08-71c0-4409-b3b6-888897271538" released by "delete_volume" :: held 0.686s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Created reservations ['92e29474-187c-4fea-944a-34bcceed00e4', '5beaa27b-6550-4e65-b252-e182b7ea1c39', 'dd661091-3c09-4400-b26f-5532a7df29e8', '6918cafb-ff32-48ba-8768-65c13658f032'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "cinder-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Acquiring lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d527a0-cfd5-4bfe-a77b-c2d81e3d1758]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:58 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:58 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:58 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce Sep 25 16:31:58 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:58 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.261s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Deleted volume successfully. Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be2cbb54-aa07-493f-a696-68d30c88f864 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-67125c08-71c0-4409-b3b6-888897271538-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:59 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" returned: 0 in 0.420s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:59 devstack sudo[109976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce Sep 25 16:31:59 devstack sudo[109976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:59 devstack sudo[109976]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" returned: 0 in 0.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "cinder-quobyte-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce" released by "delete_volume" :: held 0.770s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (0f13c0e3-e76a-4dbf-81d4-8781596245c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b12e32d-56f9-48ac-a645-46a905154d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b12e32d-56f9-48ac-a645-46a905154d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566047083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:59Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb22993-dc0f-4bdf-8c90-e222f82dbc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb22993-dc0f-4bdf-8c90-e222f82dbc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a529057-b6d5-4f76-b16e-cdd27e41c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a529057-b6d5-4f76-b16e-cdd27e41c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e', 'volume_name': 'volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d2618b-5eec-47e5-af44-d9b87d6d3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d2618b-5eec-47e5-af44-d9b87d6d3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c5e0f-039e-4037-b0a4-4a7c2c796860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Volume cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e', 'volume_size': 1} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566047083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:59Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Creating volume cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:59 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:59 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e 1073741824 Sep 25 16:31:59 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Created reservations ['dd861a3f-5f12-4e3b-8953-c41ac87149a0', '3fed8698-3a46-4dfa-a2f1-90a22a3554c2', 'a16e339b-d4f3-47aa-9f35-cb7062caa342', '0ffa7cff-a79b-470b-9d18-d4c8de42f790'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:59 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:31:59 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:00 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.319s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Deleted volume successfully. Sep 25 16:32:00 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e 1073741824" returned: 0 in 0.484s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7a7e0c21-1be3-4890-b1ac-cc3fc4bb172b tempest-ProjectReaderTests-296435232 None] Lock "cinder-bc6ff6c0-4bbb-4e87-94d4-8f93c35162ce-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:00 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e Sep 25 16:32:00 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:00 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" returned: 0 in 0.254s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c5e0f-039e-4037-b0a4-4a7c2c796860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7db2f6-cd15-48ef-864a-7f25a7866b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Volume volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e (cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e): created successfully Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7db2f6-cd15-48ef-864a-7f25a7866b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (0f13c0e3-e76a-4dbf-81d4-8781596245c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-161e78cc-3df1-4bbe-9a0b-6f85289646cc tempest-ProjectReaderTests-1881910728 None] Created volume successfully. Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-quobyte-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb5ec4-48db-4bb3-a244-88e3eeba7f14]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:32:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:01 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e Sep 25 16:32:01 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:02 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" returned: 0 in 0.416s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:02 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e Sep 25 16:32:02 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:02 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" returned: 0 in 0.269s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e" released by "delete_volume" :: held 0.735s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Created reservations ['68c13845-9853-4dbf-b78c-44d981d9fea6', '5e4fb166-825d-4585-91d8-5f44b9faca8c', 'b93427f5-1f68-4d6f-b5cc-cc0500d8ac41', 'f176bb14-d591-4007-a4ef-28b0c11c63ee'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:02 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:32:02 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:02 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.271s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Deleted volume successfully. Sep 25 16:32:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-abf4ef88-c817-4a51-87b4-28eb72c109e6 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-cf9ea3b2-7ada-4c73-b821-d2eb5bbfcf2e-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (75f0c63b-23a1-449b-86a2-7ede77c57cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67746ffe-1386-4446-84c7-6e75d3f5cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67746ffe-1386-4446-84c7-6e75d3f5cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882670933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5812d2e-c18b-4d2a-af2a-4e33fb7e6598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:03Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e3a98-1c44-423c-87ea-8c159cc0e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e3a98-1c44-423c-87ea-8c159cc0e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b90774-ab1d-4408-ad56-90c60d5c4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b90774-ab1d-4408-ad56-90c60d5c4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5812d2e-c18b-4d2a-af2a-4e33fb7e6598', 'volume_name': 'volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6521d7f-266f-43b9-a5f6-d17a801fc46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6521d7f-266f-43b9-a5f6-d17a801fc46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49bda3f-af34-4b20-9af4-60bf5cf6b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Volume f5812d2e-c18b-4d2a-af2a-4e33fb7e6598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598', 'volume_size': 1} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882670933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5812d2e-c18b-4d2a-af2a-4e33fb7e6598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7c8ba892b43b1b87b8e5ed43ca7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:03Z,use_quota=True,user_id='71fc4b694d15428f8028938615d7a21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Creating volume f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:32:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:03 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 1073741824 Sep 25 16:32:03 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:03 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 1073741824" returned: 0 in 0.420s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:04 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 Sep 25 16:32:04 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:04 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" returned: 0 in 0.243s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49bda3f-af34-4b20-9af4-60bf5cf6b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc55fb-d940-42b8-9b2c-07c089e5b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Volume volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 (f5812d2e-c18b-4d2a-af2a-4e33fb7e6598): created successfully Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc55fb-d940-42b8-9b2c-07c089e5b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Flow 'volume_create_manager' (75f0c63b-23a1-449b-86a2-7ede77c57cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-96e21d5d-7f63-47ea-a99f-1185fd1d85e5 tempest-ProjectReaderTests-1881910728 None] Created volume successfully. Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "cinder-quobyte-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[76515e17-73c2-4744-8428-bcea4b2aca3b]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:05 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 Sep 25 16:32:05 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:05 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" returned: 0 in 0.398s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:05 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598 Sep 25 16:32:05 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:06 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:32:06 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:06 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" returned: 0 in 0.286s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-quobyte-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598" released by "delete_volume" :: held 0.737s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Created reservations ['5e78ebf0-167b-4cb6-a75c-42d9537d63bc', '16fbec03-9c9c-4bb3-b68e-a15c307a3e76', '4d7efa2e-566b-44e5-b32f-8d3734951fa4', 'ae403361-c8b8-4d0b-a62d-c8d51c698368'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:06 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:32:06 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:06 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.293s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca52c6d4-3a01-4687-a6b2-89bb76a92521 None None] thread info: [<_MainThread(MainThread, started 136758404440192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:32:06 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.302s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Deleted volume successfully. Sep 25 16:32:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4387e295-3ce7-45b7-a9b0-bfe4fa99d7a1 tempest-ProjectReaderTests-1881910728 None] Lock "cinder-f5812d2e-c18b-4d2a-af2a-4e33fb7e6598-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:16 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=115,cinder:SELECT=86,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:32:16 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=75,cinder:UPDATE=110,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Flow 'volume_create_manager' (25e8c935-7efa-4860-9146-94d2608bb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab8723-f5a2-4b34-8360-411ff5c6ea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab8723-f5a2-4b34-8360-411ff5c6ea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097066133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555deefa-201a-4a90-b15b-109ea7d91103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb99a92bd4a466bb9d671836d11725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:19Z,use_quota=True,user_id='d04560ea63f241eab893194c51776a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea4af81-59fc-42ed-8e88-98cea935f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea4af81-59fc-42ed-8e88-98cea935f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff98790-2513-4e55-977a-29011b10dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff98790-2513-4e55-977a-29011b10dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555deefa-201a-4a90-b15b-109ea7d91103', 'volume_name': 'volume-555deefa-201a-4a90-b15b-109ea7d91103', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fcea1-fd54-4dda-b229-2088129fd023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fcea1-fd54-4dda-b229-2088129fd023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6681246-4927-4034-9c85-3f9b11be5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Volume 555deefa-201a-4a90-b15b-109ea7d91103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555deefa-201a-4a90-b15b-109ea7d91103', 'volume_size': 1} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097066133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555deefa-201a-4a90-b15b-109ea7d91103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb99a92bd4a466bb9d671836d11725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:19Z,use_quota=True,user_id='d04560ea63f241eab893194c51776a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Creating volume 555deefa-201a-4a90-b15b-109ea7d91103 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:32:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:32:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:18 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 1073741824 Sep 25 16:32:18 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:19 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 1073741824" returned: 0 in 0.455s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:19 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 Sep 25 16:32:19 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:19 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103" returned: 0 in 0.246s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6681246-4927-4034-9c85-3f9b11be5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555deefa-201a-4a90-b15b-109ea7d91103', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce543ff-e428-4eea-9d0c-85092d0ae6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Volume volume-555deefa-201a-4a90-b15b-109ea7d91103 (555deefa-201a-4a90-b15b-109ea7d91103): created successfully Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce543ff-e428-4eea-9d0c-85092d0ae6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Flow 'volume_create_manager' (25e8c935-7efa-4860-9146-94d2608bb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a1182444-b638-4987-873e-8bddbf68b72e tempest-ProjectReaderTests-375885531 None] Created volume successfully. Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Acquiring lock "cinder-555deefa-201a-4a90-b15b-109ea7d91103-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "cinder-555deefa-201a-4a90-b15b-109ea7d91103-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Acquiring lock "cinder-quobyte-555deefa-201a-4a90-b15b-109ea7d91103" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "cinder-quobyte-555deefa-201a-4a90-b15b-109ea7d91103" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ddcf9-c7f3-4894-a666-eb6a57b8f1c1]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:32:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:19 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 Sep 25 16:32:19 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:20 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103" returned: 0 in 0.355s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:20 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103 Sep 25 16:32:20 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:20 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-555deefa-201a-4a90-b15b-109ea7d91103" returned: 0 in 0.247s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "cinder-quobyte-555deefa-201a-4a90-b15b-109ea7d91103" released by "delete_volume" :: held 0.644s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Created reservations ['99f53bdd-f7e0-4141-a40c-478db98c04ec', '226366e3-8b3c-4cac-822c-c4e9e496dc0e', 'c45071f1-3dd8-4149-86e9-1ef4303b9e38', 'efe2107b-7d59-4242-80b3-a7ab4c563519'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:20 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:32:20 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:20 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.235s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Deleted volume successfully. Sep 25 16:32:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7274a286-a43d-4905-9680-6ce2e0d049a3 tempest-ProjectReaderTests-375885531 None] Lock "cinder-555deefa-201a-4a90-b15b-109ea7d91103-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Flow 'volume_create_manager' (c0d89a60-e0db-46e2-a921-90ecbf1f15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b128eb32-84c1-482b-96dd-c684b5f844d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b128eb32-84c1-482b-96dd-c684b5f844d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29468819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc495a-858b-4cd3-89af-096ff910f114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb99a92bd4a466bb9d671836d11725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:21Z,use_quota=True,user_id='d04560ea63f241eab893194c51776a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd92965b-7d63-4618-95aa-aa47f25184a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd92965b-7d63-4618-95aa-aa47f25184a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac05f03-0e79-40ab-b502-dba5aca93b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac05f03-0e79-40ab-b502-dba5aca93b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dc495a-858b-4cd3-89af-096ff910f114', 'volume_name': 'volume-a2dc495a-858b-4cd3-89af-096ff910f114', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d09dc9-bd6d-44a0-8505-c20f980cbce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d09dc9-bd6d-44a0-8505-c20f980cbce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0018d7d-a25e-47e6-8200-d10c15cce604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Volume a2dc495a-858b-4cd3-89af-096ff910f114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dc495a-858b-4cd3-89af-096ff910f114', 'volume_size': 1} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29468819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc495a-858b-4cd3-89af-096ff910f114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb99a92bd4a466bb9d671836d11725d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:32:21Z,use_quota=True,user_id='d04560ea63f241eab893194c51776a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d4d515-8016-495d-b5b3-e40cb81ac412),volume_type_id=82d4d515-8016-495d-b5b3-e40cb81ac412)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Creating volume a2dc495a-858b-4cd3-89af-096ff910f114 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Selected osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:32:21 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] casted to osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1 Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:21 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 1073741824 Sep 25 16:32:21 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:21 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 1073741824" returned: 0 in 0.433s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:21 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 Sep 25 16:32:21 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:22 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114" returned: 0 in 0.262s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0018d7d-a25e-47e6-8200-d10c15cce604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dc495a-858b-4cd3-89af-096ff910f114', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552419dd-f251-4394-8d28-234fd849f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:32:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Volume volume-a2dc495a-858b-4cd3-89af-096ff910f114 (a2dc495a-858b-4cd3-89af-096ff910f114): created successfully Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552419dd-f251-4394-8d28-234fd849f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Flow 'volume_create_manager' (c0d89a60-e0db-46e2-a921-90ecbf1f15b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:32:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e89dcb91-c9a6-4919-b32d-32f6b2adb90c tempest-ProjectReaderTests-375885531 None] Created volume successfully. Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Acquiring lock "cinder-a2dc495a-858b-4cd3-89af-096ff910f114-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "cinder-a2dc495a-858b-4cd3-89af-096ff910f114-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Acquiring lock "cinder-quobyte-a2dc495a-858b-4cd3-89af-096ff910f114" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "cinder-quobyte-a2dc495a-858b-4cd3-89af-096ff910f114" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5d1a3-ae2f-4b8b-a822-ca9b7a262d94]: (4, 'qcow2') {{(pid=88968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:22 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 Sep 25 16:32:22 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:22 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114" returned: 0 in 0.349s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:22 devstack sudo[110070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114 Sep 25 16:32:22 devstack sudo[110070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:23 devstack sudo[110070]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f/volume-a2dc495a-858b-4cd3-89af-096ff910f114" returned: 0 in 0.251s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "cinder-quobyte-a2dc495a-858b-4cd3-89af-096ff910f114" released by "delete_volume" :: held 0.643s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Created reservations ['615bd4c5-8e3d-4306-95b3-5eeeebcf04bb', '16da2559-c973-4230-964b-dbef3d9a73d3', '9757b628-2403-4e04-ace1-a57798637b4b', '3c004b1a-3460-49a7-adda-7118131958b6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30ea6a09-0384-4ad5-bcc4-0e71338dc5d1'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:32:23 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f Sep 25 16:32:23 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:32:23 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e851c515a98a3575b5d19f9d732ab8f" returned: 0 in 0.234s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:32:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Deleted volume successfully. Sep 25 16:32:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9f405e47-be54-4a46-91a6-75750ef87c31 tempest-ProjectReaderTests-375885531 None] Lock "cinder-a2dc495a-858b-4cd3-89af-096ff910f114-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:32:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=16,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:32:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=23,cinder:SELECT=12,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}